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INTRODUCTION 


s three volume report documents the results of a Phase II Small Business Innovation Research (SBIR) 
tract to develop an on-line means to predict aircraft loss of control using wavelets. Systems 
:hnology, Inc. (STI) conducted the work for NASA Dryden Flight Research Center at Edwards, CA. 

5 overall objective of this proposed program was to apply wavelet technology in the form of a Loss of 
itrol Analysis Tool Set or LOCATS as a means of predicting loss of control for the broad range of 
actory automatic and manual control system problems. These control problems are those that escape 
action by typical design criteria and methodologies, surface under unusual or rare circumstances, and 
;aten flight safety. Specific Phase II technical objectives were as follows: 

• Extend the capabilities of the LOCATS to include improved wavelet formulations for 
real-time applications with validity measures; 

• Identify time varying pilot-vehicle system characteristics that can be an indicator of 
impending loss of control; 

• Identify, develop and validate wavelet-based time varying metrics to predict loss of 
control of automatic and manual flight control systems and to monitor overall flight 
control system health; 

• Develop software and/or hardware solutions for the implementation of the real-time 
LOCATS; 

• Provide a graphical user interface, real-time graphics displays, and networking 
capabilities for the prototype real-time LOCATS; and 

• Evaluate the prototype real-time LOCATS in a piloted simulation that features flight 
control system software and hardware representative of current state-of-the-art 
aircraft. 

; evaluation of the prototype LOCATS was conducted using the flight control system hardware-in-the- 
p simulator facility of BAE SYSTEMS Platform Solutions Sector (here after referred to as BAE 
STEMS) of Johnson City, NY. 

lume I of this report begins with an overview of issues involving aircraft loss of control. This is 
lowed by a description of the LOCATS software, detailed development of the wavelet-based loss of 
itrol detection techniques, and a discussion of the results from the LOCATS piloted simulation 
iluation. Supporting material is provided in the appendices. Volume II of this report provides the 
•CATS piloted simulation test plan and detailed descriptions of the simulation checkout and formal 
iluation. Finally, Volume El of this report contains the LOCATS User’s Guide. 
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2. OVERVIEW OF LOSS OF CONTROL ISSUES 


2.1 The Loss of Control Problem 

This section provides a review the aeronautical problem that has motivated this work with wavelet 
analysis. In a modem aircraft flight control system (FCS) the likelihood of a catastrophic component 
failure (hardware and/or software) is minimized through redundancy and fault detection schemes. In fact 
most FCS components are designed to operate under multiple degradations and software is designed for 
robustness in the presence of aircraft model uncertainties. In light of these features, flight safety can still 
be jeopardized by loss of FCS control that can result from events originating in the instrumentation, 
actuation, aircraft components, or software. These events are not necessarily failures in and of 
themselves. Their propagation through the FCS can, however, result in an overall system failure. 

Examples of such events include the X-31A crash, the JAS 39 Gripen departure and crash, Boeing 737 
rudder failures, and the YF-22 PIO. On 19 January 1995, the X-31A research aircraft crashed at Edwards 
AFB, CA due to suspected pitot-static system icing. Although the instrument failure has been identified 
as the root cause of the incident, many other issues regarding: safety entered into the mix as outlined in 
Ref. 10. In August 1993 the JAS 39 Gripen crashed during an air show when the pilot lost control of the 
aircraft following a steep turn. A report on the investigation of the event found that the control surfaces 
were driven at their rate limit and the resulting phase lag in the control loop became too large for the 
flight control system to maintain stability (Ref. 1). In March 1999 the National Transportation Safety 
Board (NTSB) determined that the Boeing 737 rudder system led to the 1991 USAir and the 1994 United 
Airlines crashes and one near-crash in 1996. The NTSB unanimously concluded that the onboard rudder 
system is not reliably redundant and that component failures and malfunctions are still possible (Ref. 2). 
Finally, a number of factors led to the dramatic YF-22 pilot-induced oscillation or PIO and subsequent 
crash. Although an Air Force report on the incident indicated that there were no failures per se, the flight 
control system gains set by the software when thrust vectoring is active led to a configuration that was 
PlO-sensitive (Ref. 3). Once the PIO was initiated the surface actuators became rate limited, introducing 
further control lag that worsened the oscillation. 

The above examples emphasize the refractory technical problems that surround the design and 
development of modem flight control systems. As discussed below these technical problems include: 

• Control system nonlinearities (e.g., rate limiting, command path gain shaping, etc.); 

• Transitions in quadratic dipoles from favorable to unfavorable (e.g., changes in flexible mode 
characteristics resulting from the release of stores); 

• Controller gain mismatch; 

• Signal aliasing; and 

• PIO tendency. 

2.2 FCS Nonlinearities and Loss of Control 

In conventional manual control systems the primary introduced nonlinearities are rate and position limits 
intrinsic to surface actuators and various preloads, thresholds, and detents intended to offset frictional and 
other unfavorable effects and thereby improve the threshold properties of the cockpit manipulators. Fly- 
by-wire/fly-by-light FCS, on the other hand, provide a variety of possibilities for deliberate nonlinearities 
on an easy to mechanize basis. At the outset, the more elaborate variety of system mode possibilities 
requires a fairly large number of nonlinear elements just to cope with FCS mode and aircraft 
configuration shifts, various changing interfaces, etc. The easy to mechanize features of digital control 
also provide a fertile field for the introduction of special situation-sensitive features intended to offset 
some perceived unfavorable events. There is not always, however, a comprehensive understanding and 
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predation of the accompanying side effects, not the least of which can be an enhanced susceptibility to 
O and other loss of control scenarios. 


le locations of common FCS nonlinearities are shown in Figure 1. These include gain shaping of the 
lot’s input command, software and actuator rate limits, and control surface position limits. Although 
e use of these nonlinearities is commonplace and appropriate, it is always desirable to design a system 
at is as linear as possible (Ref. 4) thereby avoiding rare but potentially catastrophic loss of control 
ents. Such events have been demonstrated in several highly visible events including the YF-22 PIO 
tere inappropriate command gain shaping resulting from FCS mode switching produced severe elevator 
te limiting and the Gripen departure that also featured severe rate limiting (Ref. 5). Events of this 
ture, though not catastrophic, have also been encountered during the development of two recent FBW 
insports, the Boeing 777 and C-17. 



2.1 Rate Limits 

ften times software rate limits are placed in series with the actuator limit to insure that the actual 
lysical limit of the actuator is not encountered, thus preventing potential damage to the flight hardware, 
is not unusual for these nonlinearities to be found in the feedback path as well. As described in Ref. 6 
e primary difference between the software limit and the hardware limit is the significant loss in actuator 
mdwidth that accompanies the hardware limit when saturated. A simplified model of a rate-limited 
tuator is shown in Figure 2. As long as the error signal, e, remains below the saturation point, e L , the 
stem behaves as a linear first order lag whose response is entirely dictated by the time constant, T = 
C0a, where (Oa is the actuator bandwidth. When saturation occurs the surface will move at its maximum 
te, Vl, until the commanded magnitude, frequency, or both are reduced. Saturation occurs when the 
ror signal exceeds the saturation point (i.e., e > eL = V L /to,,). It is also convenient to define a nonlinear 
stem time constant, Tnl = A /V L , where A is the amplitude of the input command. Although this time 
mstant applies only to the indicial (step) response describing function, it has been shown to have an 
iportant role in characterizing the nonlinear system for other input forms (Ref. 6). 



Figure 2. Simplified Actuator Model 


igure 3 displays the closed loop actuator time responses for a saturation case with an input amplitude of 
5°. The error signal still appears more or less sinusoidal even though the 2° saturation point is generally 
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exceeded throughout the run length. The nonlinear nature is more evident in the actuator rate response 
that appears box car-like for this highly saturated case. In the lower panel, the actuator output position is 
compared to the input command. A triangle wave output response is displayed that reverses when 
approximately equal to the input (i.e., when the error signal passes through zero). For the linear case, the 
delay between the output and input is the linear time constant or 0.05 sec. In the nonlinear case shown 
below, this delay has increased to 0.15 sec. 



In general, rate saturation results in an amplitude reduction and a significant added phase lag. These 
characteristics are displayed in the magnitude and phase curve families of Figure 4. Both sets of curves 
are plotted as a function of normalized frequency, co/co a , and the linear to nonlinear time constant ratio, 
T/Tnl. In the sinusoidal input case T/Tnl is equal to Vt/((OaA). Thus, the two plots display the describing 
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ction magnitude and phase of the nonlinear system in terms of the actuator design parameters (Vl and 
and the input parameters (A and co), all known quantities. There are several observations to note from 
plots. First, the T/Tnl = 1 curve represents the linear case. Second, the more highly saturated cases 
resented by the smaller time constant ratio curves, depart from the linear curve at a normalized 
juency that is equivalent to their time constant ratio. For example the T/T NL = 0.1 curve departs from 
linear curve at a normalized frequency of 0.1. Another more significant result is that known design 
input parameters can be used to identify the added phase lag due to a rate limiting actuator. 



0.01 0.1 1 10 



Figure 4. Frequency Response of Nonlinear Actuator Model 

software rate limit can be represented by the actuator model described above where the bandwidth is 
actively infinite (i.e., T/Tnl — > 0) as discussed in Ref. 7. Although Figure 4 displays both an amplitude 
luction and added phase lag due to rate limiting, it is the added phase lag that is the dominant effect, 
us when encountered in a FCS or a PVS, the primary effect of actuator or software rate saturation is to 
lsume available phase margin that can then lead to loss of control. 
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2.2.2 Nonlinear Gain Shaping 

The most common deliberately introduced nonlinear feature of a FCS is a variable gain in the pilot 
command pathway. An example gain shaping block is shown in Figure 5. The slope around neutral, K lf is 
optimized for high pilot gain (low amplitude) precision control. K 2 and often other break-up slopes are 
optimized to achieve full output with maximum input. The describing function for the command shaping 
element is N(a/A), where A is the input amplitude. 



Figure 5. Example Command Gain Shaping Nonlinear Element 

From Figure 5 the linear range is defined for an input amplitude |A| < |a| and the peak output amplitude is 
proportional to Kj (i.e., 8 m = KjA). For a sinusoidal input with amplitude A, the periodic output when |A| 
> |a|, will have a peak amplitude given by, 5 m = K^a + K 2 (A - a) . Using the peak value for the amplitude 

as an approximation of the fundamental component of the periodic output gives the describing function 
estimate shown below: 


| N | _ hMdl = K, - (K, - K,)^- 

Gain shaping nonlinearities can lead to a reduction in system stability when unexpected jumps in gain 
occur (e.g., YF-22 PIO). The reduction in stability with increased gain may result directly from reduced 
gain margins or the introduction of other nonlinearities (e.g., rate limiting). 

2.2.3 Mechanical FCS Nonlinearities 

As described in Ref. 8 mechanical FCS nonlinearities that can influence system performance include 
friction and hysteresis, inceptor preload, and inceptor to surface gearing. Because friction is unavoidable, 
it must be minimized in the design process. Coulomb friction in a mechanical inceptor (stick, pedal, etc.) 
always opposes the motion of the inceptor. This will produce a displacement versus force hysteresis loop. 
In high gain scenarios limit cycle oscillations in the FCS and/or AFS are possible in the presence of 
hysteresis. Preload is used to return the inceptor to a centered position and also to reduce the dynamic 
consequences of hysteresis through describing function attenuation and phase reduction (Ref. 8). Inceptor 
to surface gearing is usually designed to provide a nearly constant gradient for trim conditions throughout 
the flight envelope and increased gradients near full surface deflection to prevent excessive stick 
deflection or force requirements while maneuvering. 

23 Additional FCS Loss of Control Mechanisms 

a. Unfavorable Quadratic Dipoles 

The presence of lightly damped quadratic dipoles (i.e., a quadratic pole-zero pair) that result from various 
feedback control scenarios can be lead to system instability. These dipoles are especially troublesome 
when they occur in the frequency region of piloted control. Although there are several notorious rigid 
body scenarios (Ref. 8), these quadratic dipoles are also associated with flexible modes. In general, an 
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unfavorable and potentially unstable (closed-loop) condition arises when the numerator zero is at a higher 
frequency than the pole, while a favorable and stable condition arises when the pole frequency is higher. 
These pole-zero location effects are exemplified in the system survey plots of Figure 6. For AFS systems 
favorable dipole pairs (scenario “b” in Figure 6) may also become unfavorable (scenario “a” in Figure 6) 
as store configurations change. 
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2.3.1 Gain Mismatch 

The determination of the optimum FCS controlled element gain is clearly a matter of supreme importance 
to assure a favorable pilot-aircraft interface, effective pilot-vehicle interactions, and an absence of PIO 
tendencies. With conventional center sticks, pedals, and yokes decades of past practice provide traditional 
answers. With the introduction of full-authority stability augmentation and fly-by-wire/fly-by-light 
systems the stick “inceptor” has permitted the introduction of many other options. These range from side 
versus center cockpit locations, force-alone versus various degrees of motion, etc. Also, the inceptors 
have become “subsystems” by incorporating sensors and frequency and nonlinear amplitude shaping 
circuits. Further, the harmonization of within- and between-axis characteristics of cockpit inceptors that 
share functions, such as the conventional stick as a lateral and longitudinal controller, has new 
dimensions. Consequently, the proper setting of controlled element gain has become a nontrivial 
development aspect on every new aircraft that introduces a new inceptor at the pilot-control-system 
interface. In the absence of an extensive background of data for these there is no basis other than 
experiment to determine the optimum gains. The pathway to ultimate success has often had many 
byways, with minor wiggles, bobbles, and ratchets, as well as occasional severe PIOs. 

2.3.2 Sampling Rates and Aliasing of Signals 

Sampling at different rates in a FCS can be problematic. An example problem occurred as part of the 
Outrider Autonomous Uninhabited Vehicle (AUV) analysis conducted at STI as part of a recent 
consulting effort (Ref. 9). It was desired to calculate the transfer function from input and output signals 
that were stored on separate recorders at different sampling rates. When the transfer function was 
computed an additional phase lag was present that was not easily explainable. Further investigation 
revealed that the different sampling rates produced the additional lag that when properly accounted for 
was no longer present. 

Another possible source of trouble in the control system is aliasing of signals. An example of this was 
encountered during the development of an Active Oscillation Control System (AOCS) for the F/A-18A 
block aircraft that suffered from limit cycle oscillations between 5 and 6 Hz under certain store 
configurations (Ref. 10). Flight testing revealed that high frequency content between 35 and 40 Hz at the 
output of the lateral accelerometer was aliased (for a sampling rate of 40 Hz.) into the problem frequency 
range of 5 to 6 Hz. 

2.3.3 System Failures 

Other mechanisms that can lead to FCS loss of control include sensor loss, actuator failures (hydraulic or 
electric), software failures, and battle damage. Many of these mechanisms are routinely handled through 
required system redundancy. 

2.4 Pilot-Vehicle Systems and Loss of Control 

The range of human pilot control possibilities as part of a pilot-vehicle system (PVS) comprises three 
fundamental modes of dynamic behavior (Ref. 11). These correspond to the three-pathway structure 
shown in Figure 7. The pathways are internal organizations of the pilot’s perceptions. They underlie and 
correspond to the following pilot control behavior patterns: 

• Closed-loop (compensatory) - pilot controls outputs driven by PVS errors; 

• Combined Open- and Closed-loop (pursuit) - pilot control is dependent on PVS errors plus 
known or induced input commands and/or system outputs. 

• Open-loop (precognitive) - highly-skilled and practiced pilot programmed control outputs to 
command the aircraft to a new state. 
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Figure 7. Three Modes of Perceptually Centered Model of Pilot Behavior 

In both compensatory and pursuit operations the pilot is highly interactive with the aircraft on a 
continuous basis, whereas in precognitive operations the pilot’s actions are essentially discrete and 
independent of the aircraft’s response during the time period of the pilot’s programmed command. 
Precognitive behaviors constitute the vast majority of pilot activities in nominal aircraft maneuvers where 
the pilot’s outputs are a stored repertory that axe released in a timely and appropriate fashion. These 
open-loop sequences may be short, as with a pseudo bang-bang control, or long, as in generating a 
synchronous sine wave. The aircraft simply responds without further pilot intervention. Of course, if the 
ultimate response is not as desired, the pilot may insert another control sequence. In compensatory and 
pursuit processes the pilot is part of a feedback control process, with all of the advantages and 
disadvantages (e.g., possible instabilities leading to loss of control) associated with this kind of control. 

b. Compensatory Control Behavior 

Here, the crossover model will be applied as a “truth” model for assessment of pilots performing 
precision tracking tasks. There is a wealth of research concerning the development of pilot behavior 
models including the crossover model. As detailed in Ref. 11, the crossover model is valid for single-loop 
compensatory control (e.g., precision tracking). A block diagram for the compensatory control scenario is 
shown in Figure 8. As shown in the figure, the pilot controls the system output, m, in response to the PVS 
error, e. 


System 
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Figure 8. Compensatory Control Scenario 


In short, the crossover model states that the pilot-vehicle system can be represented by the following 
equation: 
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In the above equation and figure Y p is the pilot describing function, Y c is the controlled element, is the 
crossover frequency, and t e is the effective system time delay. The key variables, 0 ) c and z e , are functions 
of the controlled element dynamics (airplane model), task variables (desired and adequate performance 
requirements), and environment (system delays, field-of-view, etc.). The crossover frequency is defined 
as the frequency on a Bode plot at which the pilot-vehicle system open-loop describing function 
amplitude ratio crosses the 0 dB line. It has been demonstrated through extensive research that those 
controlled elements that are most “k/s-like” in the region of crossover require the least compensation by 
the pilot. In turn, as pilot compensation increases, the achieved crossover frequency decreases. The 
effective system time delay is a function of the high frequency flight control system and aircraft dynamics 
(e.g., actuators, structural filters, structural modes, etc.) and pilot added time delays due to lead 
generation. Once again, the more “k/s-like” the controlled element is in the region of crossover, the less 
pilot lead compensation will be required and the smaller the effective time delay. When little or no lead 
generation is required by the pilot and the higher frequency dynamics are negligible, the effective time 
delay will consist solely of the delay in the human pilot’s response. This delay has been shown to be in 
the neighborhood of 0.2 to 0.25 sec. 

The closed-loop characteristics of the crossover model as defined in Ref. 11, allow the system phase 
margin to be defined in terms of the key model parameters as shown in the following equation, 

. It 

<t>u = 2~ T ‘ a) < 

For evaluation tasks defined by known forcing functions and measured error signals (such as a sum-of- 
sines tracking task), key parameters such as crossover frequency are measured directly. These proven 
handling qualities experimental techniques will be used to evaluate and refine the metrics defined as part 
of the wavelet analysis techniques. 

2.4.1 Pursuit Control Behavior 

A block diagram of a pursuit control scenario is shown in Figure 9. In this instance the pilot is able to 
perceive system inputs and can then operate on both the error (Y p ) and the input forcing function {Y p ). 

The actual input may be shown on a display, or may be deduced by the pilot by virtue of the available 
cues. To clarify this point, consider the probe-and-drogue refueling task. When beginning the approach 
to the drogue, the pilot perceives the motions of the drogue (the input) against a background of the tanker, 
horizon, and any context such as clouds. As the aircraft nears the drogue, the pilot’s attentional field 
begins to narrow or tunnel as the permissible error is reduced. In the process the pilot becomes focussed 
on the “error” (probe-and-drogue displacement) rather than the “input” and aircraft “output” as well as 
this error. The pilot’s control output becomes conditioned on the error alone, and behavior changes from 
“pursuit” to “compensatory.” In pursuit behavior the controlled element block shown in the figure 
remains unchanged from the previous scenario. 



Figure 9. Pursuit Control Scenario 
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The output over error describing function is defined by, 

v m 

'' i-y.y, 

When the pilot responds to error alone, the above equation reduces to the compensatory case. The closed- 
loop and error over input describing functions are, 

m y, nfe+n.) t i i -y,y„ 

i 1 *Y„ 1 +Y,Y ri i 1 +Y, l + YJ r 

As the denominator for this scenario is 1 + Y c Y p , the PVS stability remains a function of only the 

compensatory system. A pilot performing pursuit control behavior will attempt to make Y fi veiy large so 

that the |m|/|i|— > 1 and |e[/|i|—» 0. In the limit this can approach ideal “precognitive” control where Y pi can 

exactly invert Y c . Then Y p =1/ Y c and m/i =1 and there is no closed-loop control. In any event the feed 

forward element does, however, improve overall system performance. In general, the PVS closed-loop 
bandwidth and apparent crossover frequency (when estimated by measurements of m/e) will be higher. 

2.4.2 Pilot-Induced Oscillations 

Pilot-induced oscillations or PIOs are perhaps the most common type of pilot-vehicle system loss of 
control. PIOs have been an aviation safety problem since the Wright Brothers first powered flight 100 
years ago. As the state-of-the-art in aircraft technology advanced, the root causes of these unfavorable 
couplings has changed, yet the problem remains - even with the most advanced FBW designs. In 1997 
the National Research Council published a report entitled Aviation Safety and Pilot Control (Ref. 5) that 
provided a series of recommendations to minimize the occurrence of these rare, but extremely hazardous 
events. In the time since this report was published, a number of severe events have occurred in 
commercial aviation, some of which resulted in serious injuries and fatalities. Specific examples are 
given in Table 1. Figure 10 shows flight data recorder time histories from the Falcon 900 PIO. The 
severity of the event is illustrated by the oscillations in vertical acceleration of greater than 4g and -3g. 
Furthermore, there have been a number of military examples of unfavorable pilot-vehicle interactions 
since the publishing of the NRC report. These include the shipboard landing PIO examples listed in 
Table 1 that could have easily resulted in lost or damaged aircraft had the tasks not been successfully 
aborted. These events clearly demonstrate that unfavorable pilot-vehicle interactions remain a threat to 
aviation safety. 

Although PIOs have similar defining traits, the causal factors can be quite varied. Thus, we have come to 
categorize PIOs in terms of existing pilot behavior models and analysis techniques. These categories are 
summarized below from Ref. 5. 

Category I - Essentially Linear Pilot-Vehicle System Oscillations: The effective controlled element 
characteristics are essentially linear, and the pilot behavior is also quasi-linear and time-stationary. The 
oscillations are associated with high open-loop system gain. The pilot dynamic behavior mode may be 
pursuit, compensatory, or synchronous. 

Category II - Quasi-Linear Pilot-Vehicle System Oscillations with Series Rate or Position Limiting: 
These are severe PIOs, with oscillation amplitudes well into the range where software and/or actuator rate 
and/or position limiting in series with the pilot are present as primary nonlinearities. Rate limiting, either 
as a series element or as a rate-limited surface actuator, modifies the Category I situation by adding an 
amplitude-dependent lag and by setting the limit cycle magnitude. Other simple nonlinearities (e.g., stick 
command shaping and some aerodynamic characteristics) may also be present. These are the most 
common and easiest to analyze true limit-cycle severe PIOs. 
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Table 1. Recent Commercial and Military PIO Events 


Date 

Aircraft 

Flight Details 

Event Description 

8 June 97 

MD-11 

JAL Flight 706 
1 fatality 

PIO Pilot attempted to manually 
override autopilot & deploy speed 
brakes 

1 Jan. 99 

B-767 

AA Flight to UK- 
Heathrow 

PIO on first touchdown bounce 
resulting in compression buckling of 
fuselage skin 

14 Sep. 99 

Falcon 900 

Olympic Airways Flight 
to Bucharest Romania 
7 fatalities 

PIO followed autopilot disengage. 
Aircraft was dispatched with failed 
pitch force feel system. 

8 Feb. 01 

A-321 

Air France to UK- 
Heathrow 

Roll PIO followed sudden left wing 
drop 

17 Mar. 
01 

A-320 

NW Flight 985 from 
Detroit 

Elevator not trimmed for takeoff. 
Pitch PIO resulted in aborted takeoff. 

1 Feb. 99 

V-22 

Sea Trials 

Roll PIO followed saturation of 
AFCS 

8 Mar. 99 

F/A-18 F 

Follow-on Sea Trials 

Roll PIO followed rate saturation of 
lateral actuators resulting in bolter 


• ' wwin ■ mr M'i mrn m »■>'■*! w ii n 


Figure 10. Flight Data Recorder Time Histories from Olympic Airways PIO (Ref. 12) 
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Category El - Essentially Non-Linear Pilot-Vehicle System Oscillations with Transitions: These PIOs 
fundamentally depend on nonlinear transitions in either the effective controlled element dynamics, or in 
the pilot's behavioral dynamics. The shifts in controlled element dynamics may be associated with the 
size of the pilot’s output, or may be due to internal changes in either control system or 
aerodynamic/propulsion configurations, mode changes, etc. Pilot transitions may be shifts in dynamic 
behavioral properties (e.g., from compensatory to synchronous), from modifications in cues (e.g., from 
attitude to load factor), or from behavioral adjustments to accommodate task modifications. 

With existing criteria the likelihood of Category I PIOs is now easily minimi zed in the FCS design 
process. Because of the presence of significant nonlinearities in the controlled element, the human 
operator or both, the prediction of susceptibility to Category II and m PIOs is much a more troublesome 
problem. 
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3. DESCRIPTION OF THE LOSS OF CONTROL ANALYSIS TOOL SET (LOCATS) 
3.1 Overview 

The LOCATS application is a real-time analysis tool that is designed to detect impending loss of control. 
The loss of control may originate within an automatic flight control system mode or a pilot-vehicle 
system. The most common form of loss of control within a pilot-vehicle system is the pilot-induced 
oscillation or PIO. In Phase I, the feasibility of the LOCATS concept was demonstrated using a wavelet 
toolbox developed by STI using Matlab (Refs. 13 and 14). In Phase 13 this toolbox was used to further 
develop and evaluate the wavelet-based estimation techniques and to assess time-varying loss of control 
metrics. 

A program flow diagram for the LOCATS software is shown in Figure 11. All program options and data 
manipulation features are accessed via the graphical user interface or GUI. Program options include 
selection of desired wavelet-based analysis tools, loss of control metrics, and data displays. The input to 
the software is a set or subset of aircraft signal variables that are available from the simulator via the SBS 
Technologies 1553 data bus card installed in the host PC. In this case the aircraft signals are selected 
from those available within the structure of the BAE SYSTEMS simulator facility. From these signals a 
user-selected subset is sent to the wavelet analysis module from which time varying frequency responses 
and related computations are made. These data are then used to exercise the user-selected loss of control 
metrics. Finally, the results are presented graphically via the data display module. This process takes 
place in real-time, so that impending loss of control may be detected early enough for the pilot to receive 
appropriate warnings and take corrective actions. 



Figure 11. LOCATS Program Flow Diagram 


A LOCATS User’s Guide is included as Volume HI of this report. The reader is directed to that volume 
for specific details concerning the use of the software. The following sections will provide a brief 
summary of the software components identified in Figure 11. 

3.2 The Graphical User Interface 

As mentioned above access to LOCATS options and features is provided via the GUI and details 
surrounding its use are featured in the Volume IH User’s Guide. The LOCATS main window is shown in 
Figure 12. Data handling features are exercised using the toolbar icons at the top of the window. The 
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icons from left to right, Save Collected Data, Set Configuration Options, Load Data from a File, Add New 
Plots, Begin Data Collection, Pause Playback, Stop Data Collection, and Plot Existing Data. A running 
log of LOCATS execution is provided under System Information. The wavelet-based analysis tool of 
choice is selected via the Analysis Method box. Because the WERA method was a more recent 
development, it has not yet been fully integrated into the software, and hence only one analysis method 
can be used at a time. The final feature of the LOCATS main window is the Active Plots listing. From 
this listing the various run-time plots can be configured for a given data collection scenario or off-line 
analyses. 
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Figure 12. The LOCATS Main Window 


3.3 The Wavelet-Based Analysis Tools 

Two wavelet-based analysis methods have been developed for use in LOCATS. The first is the time 
varying transfer function (TVTF) method that was first introduced in the Phase I program (Ref. 13). The 
second is a wavelet eigensystem realization algorithm (WERA) method. Detailed descriptions of these 
methods are provided in Sections 4 and 5 of this report. Because both methods have unique strengths and 
weaknesses, they were both included in LOCATS for the piloted simulation assessment. Both methods 
provide results using a common set of loss of control metrics. 

Analysis options are selected prior to a data collection run using the Analysis Options window (see Figure 
13). Timing Options set the length of the transform and the interval between transforms, while fmax sets 
the maximum frequency. FFT Options set the binning or frequency averaging, the length of the 
transform, and the cosine taper fraction for the fast Fourier transform computations. CWT Options select 
the continuous wavelet transform and its properties, the length of the transform, and the number of 
frequencies for the TVTF computations. LLS Options sets the numerator and denominator order, the 
number of points used in the estimate, the minimum frequency, and the number of frequencies for linear 


TR 1341-1 


15 


least squares time series estimations. When incorporated, the WERA Options will set the parameters for 
the wavelet eigensystem realization algorithm estimates. 
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Figure 13. LOCATS Analysis Options Window 

3.4 Loss of Control Metrics 

3.4.1 Overview 

The primary goal of this program is to develop on-line tools that can identify impending loss of control. 
The wavelet-based methods provide the engine for identifying time-varying systems. Once the system 
has been identified a wealth of metrics can employed to assess the susceptibility of the system to loss of 
control. These “time-varying” metrics include classical system stability measures (e.g., gain and phase 
margins, peak magnification ratio, etc.), multivariable system robustness measures, and the many flying 
qualities measures. The focus here has been on those system changes that result in a loss of phase margin 
and therefore greatly increase susceptibility to pilot-vehicle system instabilities such as PIO. Thus, loss 
of control metrics that are sensitive to changes in phase margin were emphasized. 

3.4.2 Airplane Bandwidth 

The airplane bandwidth handling qualities criteria has been shown to be an effective indicator of degraded 
handling qualities and PIO susceptibility (Ref. 15). Thus, a time-varying version of this metric is of 
particular interest to this project. The airplane bandwidth criterion was developed from the crossover 
model concept (Ref. 16). As described in Ref. 17, the attitude bandwidth is related to the premise that the 
maximum crossover frequency that a pure gain pilot can achieve, without threatening stability, is a valid 
figure-of-merit for the controlled element. Key bandwidth parameters include the bandwidth frequency 
(tffew), the neutral stability frequency (fifoo), and phase delay, a measure of the high frequency phase roll 
off {tp). As shown in Figure 14 the bandwidth parameters are obtained from an attitude to manipulator 
force response, because the primary control cue for the pilot is attitude and not, for example, acceleration. 
In this way the higher frequency effects of actuator and inceptor dynamics are included. Examples of 
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current PIO and handling qualities boundaries for pitch attitude bandwidth are shown in Figure 15. 
Similar requirements have been defined for the roll axis. 



Figure 14. Definition of Pitch Attitude Bandwidth Parameters (modified from Ref. 3) 
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Figure 15. Example Pitch Attitude Airplane Bandwidth PIO (Thick Lines) 
and Handling Qualities (Thin Lines) Boundaries (Ref, 3) 
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An example of how the airplane bandwidth parameters may change over time is shown in Figure 3 (Ref. 
18). In this example an overall Level 1 configuration is combined with increasing levels of rate 
saturation. Here the data are plotted against a simplified version of the Figure 15 PIO boundaries. As the 
saturation level increases, the phase delay increases and the bandwidth decreases, eventually resulting in a 
configuration that is highly susceptible to PIO. 


0.4 

0.35 

“g 0.3 
' jo, 

Jp.25 

£ 0.2 
Q> 

« 0.15 


0.05 
0 

0 1 v . \::;2 :'.V3 4 5 6 / 

Pitch Attitude Bandwidth, o>Bwe (rad/sec) 

Figure 16. Example Airplane Bandwidth Variations with Increasing Rate Saturation 
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3.4.3 Other Metrics 


Additional metrics along with airplane bandwidth have been incorporated into LOCATS. These include 
the stability metrics incorporated in the STI Wavelet Analysis Toolbox during the Phase I program. For 
example, the frequency response estimate of a loop transfer function (LTF) can be used to compute 
stability metrics. A block diagram is shown in Figure 17. The signals e(t) and y(t) can be used to 
estimate the LTF. 



Figure 17. Loop Transfer Function Used to Estimate Time Varying Stability Metrics 

Alternatively, if smoothing is available, then it can be better to also use the command signal r(f) and 
compute: 

°er 

If the frequency responses are time varying then so are the stability metrics. In Phase I the classical 
stability metrics, as listed below, were implemented in the toolbox and may be easily incorporated into 
LOCATS: 
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• Phase margin (PM): For each t the frequency response g(d), t) is searched for a unit 

magnitude crossover frequency ( cd c ) and the phase margin is 180° plus the phase at 
that frequency. Log interpolation is used between frequency data points. If there is 
more than one co c then the lowest is used. Alternatively all can be kept or only the 
lowest phase margin can be kept. 

• Gain margin (GM): For each t the frequency response g(a>,t) is searched for -180° 
crossover frequency (fi^go) and the gain margin is the inverse gain at that frequency. 

Log interpolation is used between frequency data points. If there is more than one 
6\g 0 then the highest is used. Alternatively all can be kept or only the lowest gain 
margin can be kept. 

• Peak magnification ratio (M p ) : For each t the frequency response g /(I + g)(co,t) is 

computed from g(o),t) and then searched for local maxima. If there is more than 
one then the one occurring at the highest frequency is used. 

• Multiplicative robustness: For each t the frequency response 1 + g~ l (co,t) is the 
multiplicative robustness bound, defined as the largest frequency response e m for 
which g(l + e m ) can be guarantied to be stable. On three-dimensional plots peaks 
show up better than valleys, so the inverse bound g /(I + g){co,t ) is used instead (for 
which the maximum across Q) is M p ). 

These stability metrics are actually robustness measures, the distinction being not just a yes/no answer to 
stability but a measure of the nearness to instability. The phase and gain margins will each “go negative” 
when a transition to instability occurs. For automatically controlled systems this transition to instability is 
readily apparent, and in fact a warning of impending instability can be implemented, even with tin 
estimate of time remaining. For manually controlled systems the transition to instability is not so clear 
cut. A human operator can (and does) quickly change strategy and will “back out of the loop” to stabilize 
the system as was shown in Refs. 13 and 14. 


3.5 Data Displays 

LOCATS supports a number of data displays that can be selected for use in a real-time environment or for 
off-line analyses. Selection of the display types is made via the Figure 18 menu. 
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Figure 18. Selection of LOCATS Data Displays 
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The strip chart feature is available to view time series of critical signals. Up to four signals can be 
included in a single strip chart group, and multiple groups can be used simultaneously. In Figure 19 the 
strip chart time axis and signal selection windows are shown. In a real-time environment the time axis 
will scroll, as defined by user selected parameters, once the maximum time value is exceeded. Signals 
may be displayed using the Auto Scale feature or with user defined inputs. The strip chart feature also 
provides access to a wide range of advanced editing features (see Figure 19). An example four signal 
strip chart display is shown in Figure 20. 
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Figure 19. Strip Chart Time Axis Options, Signal Selection, and Advanced Editing Features 
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Figure 20. Example Strip Chart Display 

A primary feature of LOCATS is the set of real-time analysis plots. To exercise these features, the user 
first selects a display type from the Figure 18 menu. Then by “clicking” on the corresponding item in the 
Active Plots list the Figure 21 window appears. From this window the display can be given a title and up 
to four data plot channels may be defined for each display. For the transfer function estimation displays. 
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Figure 21. Estimated Transfer Function Options Menu 

For the transfer function estimation displays access to the input and output signals selection and the 
frequency axis parameters menu shown in Figure 22 is gained by “clicking” on the Frequency label in the 
Active Plots listing. Corresponding plot types (e.g., magnitude Bode, phase Bode, etc.) and related 
plotting parameters (see the magnitude Bode example in Figure 22) are then accessed through the 
Channel 1 - Channel 4 labels in the Active Plots listing. The data display options can be conveniently 
stored in a configuration file for repeated use. An example TVTF display is shown in Figure 23. Note the 
persistence lines that provide a visual cue as to how the system is changing in time. The lines change 
from light to dark as they move back in time. 
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Figure 22. Example Analysis Signal Selection and Plot Option Menus 
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Figure 23. Example TVTF Data Display 
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4. TIME VARYING TRANSFER FUNCTIONS 


4.1 Fourier and Wavelet Transforms 

Wavelet transforms may one day become common in the systems and control community, but they are 
not yet so. A good way to introduce wavelet transforms is to start with the Fourier transform, ease out of 
this familiar territory by using windowed Fourier transforms, and then from there jump to wavelet 
transforms. This is the approach we now take, comparing and contrasting, and introducing the issue of 
causality. Further details and comparisons are included in Ref. 13. 

4.1.1 Fourier Transform (FT) 

A transform, any transform, of a time function is an alternative representation of that time function as a 
sum or an integral of basis functions. The most common transform in systems engineering is the Fourier 
transform, for which the basis functions are complex exponentials. The Fourier transform pair provides a 
means to compute the coefficients of each basis function, and a means to reconstruct the original signal: 

f («)- £/(*)«-*“* 

4. 1 .2 Windowed Fourier Transform (WFT) 

The FT uses the entire time function and does not provide a means to identify where in time transient 
phenomena has occurred. It is meet this need for time localization that alternatives leading up to the 
wavelet transform are defined. The first step is the windowed Fourier transform, whereby the complex 
exponential is multiplied by a shifting time window: 

F g (co,u)= f(t)g(t-u)e~ jQX dt 

The WFT is then the frequency content of the input near the time t = u . The subscript g reminds us that a 
window is present. Reconstruction of the original signal is an important issue, for this or any transform, 
and can be done here but requires two integrations: 

For causality the time u is set at the endpoint of the window, or equivalently, g(t) is nonzero only for 
negative time. This restriction allows the computation of F g ( co,t ) for t<u based only on fit) for t < u , 
and also, to recover using the same restrictions. 

Having just defined a transform with time localization, is this enough? For many applications perhaps 
yes, but the major drawback of the WFT is that the window is the same length for all of the frequencies. 
A long window appropriate for low frequencies phenomena will average out transients that may occur at 
high frequencies. Scaling the window length with frequency, so that low frequencies have long windows 
and high frequencies have short windows is the next logical step, and this in fact is what a wavelet 
transform does. 

4. 1 .3 Wavelet Transform 

The time function is decomposed into basis functions that translate in time and whose length and 
magnitude scale with a parameter that can be interpreted as frequency: 
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w>(©,u)= (*>(*-«))<* 

The magnitude is scaled so that the basis functions all have the same norm. All of the basis functions are 
derived from (/>(t) , the so-called “mother wavelet”. The mother wavelet can be real or complex, and in 

many wavelet applications it is defined as a real function, but for applications such as LOCATS where 
phase information is important the complex exponentials are a natural choice, and therefore the following 
is used: 

#(»)-»(«)«* 

This brings the discussion back to a set of basis functions that look like those used for the WFT, but there 
is an important difference: the length (and the magnitude) of the window scales with frequency. If one 
measures the length of the mother wavelet in terms of wavelengths, then each of the scaled basis 
functions will have the same number of wavelengths. References 19, 20, 21, and 22 support the 
following developments. 

The Fourier transform of the mother wavelet, <j>{( 0 ) , scales and translates as follows: 

<j>{ t)<r±$(a>) 

s 1/2 0(s( f-«)) 

The mother wavelet as a function of time becomes taller and s kinn er with increasing scale, whereas its FT 
shrinks and gets wider. A translation in time corresponds to a phase shift. 

The original time function is recovered using another double integral: 

/(t)=^r j” 'Wp(a),u)a) 1,2 0(a)(t -u))a) 2 dtdu , C-2k j°^ ^(j>(a>)da) 

The constant C is not finite unless the Fourier transform of the mother wavelet, <p{co ) , is zero at co = 0 , a 
condition that is equivalent to saying that <f>(t) must have zero mean. 

The wavelet transform, (co, t ) , can be interpreted as the frequency response of the time function, f(t ) , 
in the neighborhood of the point co,t in the time-frequency plane. The Morlet wavelet, a favorite from the 
Phase I effort, is defined using a Gaussian window, g(t) . A nice consequence is that (pit) also has a 
Gaussian window, “nice” because a Gaussian window is smooth. There is a fundamental limit to how 
localized the wavelet transform can be in both time and frequency, akin to the Heisenberg uncertainty 
principle, which will not be discussed here, except to say that another important property of the Morlet 
wavelet is that it minimizes the time-frequency localization. 

Another way to interpret the wavelet transform is that W^(ro,r) for each frequency is a convolution of 
1/2 

f(t) and co <p(cot) . This fact can be used to calculate the wavelet transform, this is the method that was 
used in Phase I, and we also found it to be useful for real time calculations in Phase n. 

4.2 Causal Wavelets 

For causality it is required that <p(t) be nonzero only for negative time. In this case the wavelet transform 
WA(0,t) for t<u only depends on fit) for t<u , and recovery likewise. Causality is needed for real 
time operation, but “causal wavelets” are not commonly used. Causality is discussed in Ref. 22, but not 
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even defined in other standard treatments of wavelets. In Ref. 13 several causal wavelets were 
investigated: 

• Shifted Morlet, shifted to the left and the Gaussian tail truncated; 

• Dryden’s Laplace wavelet, g(t) = e +at for t < 0 ; 

• Peter’s Laplace wavelet, a variation that has zero mean; and 

• Cosine tapered, where g(t) is rectangular except first and last bit is cosine tapered. 

All were implemented in the STI Wavelet Analysis Toolbox, as is the regular, non-causal Morlet. The 
shifted Morlet had been the preferred choice, mainly because when used with test functions the wavelet 
transform is smooth. The tradeoff is delay, and a better choice was needed that compromises smoothness 
and delay. A search for additional selections of g(t) began with the one-sided probability density 
functions (PDFs), in particular the Gamma, Rayleigh, and Weibull PDFs that are basically skewed 
Gaussian and exponential functions. A description of these analytic wavelets is provided in the next 
section. 
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Figure 24. Shifted Morlet Wavelet Transform of a Test Signal 

Figure 24 gives an example of a wavelet transform computed using the shifted Morlet basis functions. 
The shifted Morlet and its Fourier transform are shown in the top part of the figure. The test input f(t) 
has two sinewaves, separated in time, at 1 and then 3 Hz. The WT shows two distinct concentrations of 
energy in the time-frequency plane. The WT is causal - the response along the time axis does not precede 
the input function. The time for the WT to reach a maximum is the same time it takes for the basis 
function to reach a maximum - about 3 wavelengths. This is the delay that we want to decrease. The WT 
response at 3 Hz is shorter by the square root of 3, and the width along the frequency axis is the same, at 
least when plotted as done here on a log frequency scale. 
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4.3 Analytic Wavelets 

In the Phase I effort that is summarized in Ref. 13 the shifted Morlet wavelet was used for most of the 
analysis. It has nice properties, such as m inimum energy localization in the time-frequency plane, and 
smoothness (a bell-shaped envelope) in both the time and frequency domain. This choice of wavelet 
suffers, however, from having a slow rise time in response to sudden changes in the signal. The additional 
wavelets evaluated in Phase II are defined below. 


4.3.1 Shifted Morlet 

The shifted Morlet wavelet is defined by. 


w(0 = 



j2Jtf c {t-c)-(t — cf'lp 


for t > 0, c > 0, P > 0 


Mean = c 


Variance - P 12 


Number of cycles to reach maximum value (for f c = 1 ) is x-c 

The frequency of the wavelet is f c Hz, and the mother wavelet is defined to have f c = 1 . The tail 
of the shifted Morlet for t < 0 is set to zero. The parameter values used in Phase 1 were c = 3 and 
P = 2 . A larger set of values is now being considered. 

Time and frequency domain plots for different parameter values are shown in Figure 25. The response of 
this wavelet to the test signal was shown previously in Figure 24. 



Figure 25. Shifted Morlet Wavelets and their Fourier Transforms 


4.3.2 Rayleigh 

The Rayleigh wavelet is defined by, 

w(t) = -^expjy'2;r/ c f-r 2 //?j for r > 0, /? >0 

Mean = ^Pn 

Variance = p{ 1-^/4) ~ /?/ 5 

Number of cycles to reach maximum value is x = yfP/2 

The envelope is a skewed Gaussian curve. Currently we are using P = 4.5 , so that the maximum 
is reached after 1.5 cycles. 
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Time and frequency domain plots for different parameter values are shown in Figure 26. The response of 
this wavelet to the test signal was shown previously in Figure 27. 



Figure 26. Rayleigh Wavelets and Their Fourier Transforms 
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Figure 27. Rayleigh Wavelet Transform of a Test Signal (P = 4.5) 

4.3.3 Erlang 

The Erlang wavelet is defined by, 

a n t n ~ x 

w(t) = -exp[ ]2jz f c t - at\ for t > 0, a > 0, n > 1 


Mean = nja 
Variance = nj a 2 

Number of cycles to reach maximum value is x = (n - 1 )/a 
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The envelope is a power of t times an exponential of t. Currently we are using n = 3 and a = 4 / 3 , 
so that the maximum is reached after 1.5 cycles. 

Time and frequency domain plots for different parameter values are shown in Figure 28. The response of 
this wavelet to the test signal was shown previously in Figure 29. 



Figure 28. Erlang Wavelets and their Fourier Transforms 


4.3.4 Weibull 

The Weibull wavelet is defined by, 

w(f) = abt b ~ l exp £ j2Kf c t - at b J for t > 0, a > 0, b > 0 

Mean= (l/a)^ b ^T{l + l/b) , where T(c) = J^° x c ~ l e~ x dx 

Variance = (l/a) (2/Z>) [r( 1 + 2 fb) - T 2 (1 + 1 /2>)] 

Number of cycles to reach maximum value is x = 

The envelope is a power of t times an exponential of a power of t. Currently we are using b = 3 
and x = 1.5 . The expressions for the mean and variance are cumbersome, but the parameters b 
and x have the most meaning, from which the others can be calculated. 

Time and frequency domain plots for different parameter values are shown in Figure 30. The response of 
this wavelet to the test signal was shown previously in Figure 31. 
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Figure 29. Erlang Wavelet Transform of a Test Signal (a = 2, n = 3) 



Figure 30. Weibull Wavelets and their Fourier Transforms 
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Figure 31. Weibull Wavelet Transform of a Test Signal (a = 0.1975, b = 3) 

Through analysis of various data sets including the LOCATS simulation data the Rayleigh wavelet was 
found to possess the characteristics required for real-time detection of changes in a dynamic system. 
These characteristics will be demonstrated later in the report. 

4.4 Discrete Wavelet Transforms 

The connection between digital and continuous wavelets is one area where the vast technical literature 
does not provide much help. For the most part the study of the two types of wavelets are disconnected. 

• The study of continuous wavelet transforms begins with the definition of the wavelet 
function, then the transform equation, and then the properties of the resulting wavelet 
transform. Families of wavelets are defined, the most famous being the Morlet 
wavelet. 

• The study of digital wavelet transforms starts with the selection of a high and low 
pass filter, then the transform algorithm, and then the properties of the resulting 
wavelet transform. What is missing is the wavelet function. It enters as a secondary 
item, something that can be computed if you want to, but not really necessary, and 
not usually done. The filters are considered to be more fundamental. Families of 
digital wavelets are defined, the most famous being Daubechies wavelets, but they 
are really families of high and low pass filters. The Daubechies wavelets are used in 
the WERA method discussed in the next section. 

The literature on this subject is not barren, however, and we have the example of Ref. 23 where this 
approximation is implemented. The objective is to understand this work and to generalize it. The main 
reference being used for the study of digital wavelets is the textbook by Strang and Nguyen (Ref. 22). 

Both the continuous and digital wavelets can be interpreted as filter banks, and this is shown in Figure 32. 
A range of frequencies is selected, each being an octave apart. The continuous wavelet at the highest 
frequency is implemented as a filter with the impulse response g(t) . The CWT has no restrictions on the 
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choice of frequencies, this is a strength of the method, but for now the “dyadic” selection of frequencies 
that is imposed by the DWT is duplicated. 

The DWT is equivalent to the filter bank using the high pass filter g(n) and the low pass filter /(n) . 
After each low pass filter the signal is down-sampled, and operation that selects every other sample. The 
low and high pass filters are the same in each branch of the filter bank. The speed of the DWT comes 
from the fact that these filters are each short finite impulse response (FIR) filters that can be quickly 
computed. One of the ways to approximate the DWT is suggested by the notation used in Figure 32: 

g(n) = g(t) ait = nA. 

where A is the sample period. In words, the digital high pass filter is set equal to the sampled continuous 
wavelet defined at the highest frequency. 



b. Digital 


Figure 32. Filter Banks Based on the Continuous and Digital Wavelet Transforms 

The digital high and low pass filters are inter-related and there are conditions of validity that must, or 
least should, be satisfied. Any low pass filter can be used in Figure 32b and implemented, but only those 
satisfying certain conditions provide perfect reconstruction, one of the requirements of digital wavelet 


TR 1341-1 


31 






transforms. Following the development in Chapter 4 of Ref. 22, the two channel filter bank with both 
analysis and synthesis portions is shown in Figure 33. 



Figure 33. Two channel filter bank with both analysis and synthesis 


The up-sample operation places a zero between each sample. The two requirements for perfect 
reconstruction are: 


Alias cancellation: / ( z ) f s (-z)+ g (z) g s (-z) = 0 
No distortion: f(z)f s (z)+g(z)g s (z) = 2z~ £ 

These conditions use the z-transforms of the filters. For FIR filters, as used here, these z-transforms are 

polynomials in z _1 . Perfect reconstruction means that the original signal is recreated with only a delay. 
The alias cancellation requirement is satisfied with the following choices of synthesis filters: 

For alias cancellation: f s (z) = g (-z) and g s (z) = — / (— z) 

The no distortion requirement is then: 

f(z)g{-z)-g{z)f{~z) = 2z~ e 

With the substitution: p(z) = f (z)g(-z) , this requirement can be written as: 

p{z)-p{-z) = 2z~ £ 

The design of digital wavelet transforms can be succinctly stated in two steps: 

• Select p(z) ; and 

• Factor into /(z) and g(-z). 

The most famous of DWTs, the Daubechies transforms, makes the selection: 

p(z) = ( \+z~ 1 f P Q{z) 

where p — t is the order of the Daubechies wavelet, and the polynomial Q(z) is of order 2p — 2. The 
no distortion requirement is used to define 2p-l linear equations that the coefficients of Q(z) must 
satisfy. The polynomial p(z) turns out to be all pass, meanin g the inverse of each root is also a root, and 
spectral factorization is used to factor p(z) into /(z) and g(z) = -z“ p /(-l/z) . 


TR 1341-1 


32 




Coining from continuous wavelets, the following method is used! 

• Sample g(t ) at the highest frequency to define g(n); 

• Select the low pass filter / (n) to be the same order, and 

• Use the no distortion requirement to create a linear matrix equation that uniquely 
defines the coefficients of fin) . 

This has been done, but problem remain. The conditions for low, high, and band pass filters are stated in 
Table 2 for digital and continuous transforms. 


Table 2. Conditions for Digital and Continuous Filter Transforms 



Low pass 

High pass 

Band pass 

Digital 

g(z) = 0 atz = -l 

g(z) = 0 atz = l 

g(z) = 0 atz = ±l 

Continuous 

gis) = 0 ats = eo 

gis ) = 0 315 = 0 

gis) = 0 at s = 0,<» 


A digital band pass filter cannot satisfy the no distortion requirement. The no distortion requirement 
cannot be satisfied if p(z) and p(—z ) have a common root, say at z = ±1 • Then the requirement 
becomes: 

P 0 2 ) ~ P H) = (■ z + !) ( ^ - 1) [Po (z ) ~ Po (-z)] = 2 z“* 

The remaining factors cannot cancel these roots, because the remaining factors are polynomials. The no 
distortion condition cannot be satisfied, and therefore a digital band pass filter cannot be used in place of 
the high pass filter in the DWT. 

Many of the CWTs are defined using analog band pass filters. In particular, the Morlet wavelet is 
equivalent to a band pass filter. The sampled Morlet wavelet is not band pass, but almost so, and is so in 
the limit as more and more samples are used. Even though not quite band pass, the no distortion condition 
is numerically ill-conditioned, resulting in a low pass filter that has coefficients for f(z) that are orders 
of magnitude higher than the coefficients for g(z ) . They should be the same size, ideally, both norm one. 
In the end, CWTs were selected for implementation in LOCATS. 

4.5 Computing the Continuous Wavelet Transform 

The Continuous Wavelet Transform (CWT) is: 

For a given frequency this is a convolution, and the CWT is computed as a set of convolutions. The 
subscript on W is changed to indicate the time series (whereas before the subscript was the wavelet 
function). 

4.5.1 Post-Processing 

When using stored data the convolution is computed using FFTs. The signals / (f) are df l2 (p‘ iQX) are 
each sampled over the time window of the stored data for a total of N points each. Forward FFTs of 
length 2 N — 1 are computed of each to prevent circular convolution, multiplied, and then the inverse FFT 
is computed to give Wf (co,u) at the selected frequency. This is the calculation used in the STI’s Matlab 
Wavelet Toolbox. Further details are in Ref. 13. 
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4.5.2 Real Time 

The real time calculations in LOCATS directly computes the convolution as an inner product of the time 
signal f(t) and cd n <p' (OX) , however to save computation time the wavelet is computed and stored one 
time with N points, using N appropriate for the lowest frequency. Typical values are N equal 4096 or 8192 
- though there is no time savings here for powers of two. The stored wavelet is down-sampled and/or 
interpolated for each of the higher frequency wavelets before computing the convolution. 

The number of multiplications for each transform is: 


i=0 


where is the lowest frequency and the Q are the remaining frequencies. If these frequencies are log- 
spaced and the highest is 0 )^ , it works out that: 


N total — N- 


Wgfr/gUx) 




Typical values are / 0)^ = 1 / 300 and N w = 120, in which case N total ~34N, and which is 
significantly less than N 2 for large values of N. 


4.6 Power Spectrum Estimation 

The main objective is to estimate the frequency response of a system, but an important first step is to 
estimate the power spectrum of the input and output time series. The computed power spectra are 
estimates, and as with all estimates there is a mean and variance of the estimate. Determining the statistics 
of the estimate is the subject of Appendix A, using material mainly from Ref. 27. The main results from 
the appendix are summarized here. 

4.6.1 Estimation Method 

The objective is to estimate the power spectra S^iJ) of the time series x(t) at a single frequency 
/ = /o Hz. It is assumed that x(t) is a stochastic processes defined as zero-mean white noise passed 
through a LTI system. The estimation method uses a LTI system, if (s) , a narrowband filter centered at 
/o Hz. The power spectra estimate is obtained as shown in Figure 34. The output of the narrowband filter 
is the time series y(t ) , and the estimate of its mean square value computed over the previous T seconds is 

y/y. The estimate is normalized by f?y,( 0) , where Rf,h( T ) is the autocorrelation of H(s) . The end result 
is the estimate of the power spectra, S^C/q) at the frequency / 0 . 


x(t) 

H(s) 

y(0 ^ 

1 r r v 2 mdt 

L 


s«(/o) „ 



Yl y (,)dt 


R hh (°) 



Narrowband filter 
/ 0 = center frequency 
B s = statistical bandwidth 


Mean square estimation 


Scaling 


Figure 34. Power Spectra Estimate 
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^ u.i mipui tain paTauietCr IS ulC balluWidth Oi tiiC liaxiOyvualid filter. Qualitatively, tiiS baxici vViutii IS tllC 
width in frequency where the spectrum of the filter has most of its power. The particular definition of 
bandwidth that works the best for power spectral estimation is the so-called “statistical bandwidth:” 






-i2 


2 L ShhWf 


RLi Q) 4,(0) 

2j^^(T)T 2 Vl (0) 


Several equivalent expressions for the statistical bandwidth are given above. All have their use for theory, 
and it turns out the last of these, using ( t ) = h(t) * h(t) is the best for computation. 


4.6.2 Statistics of the Estimate 

Using the spectrum estimate in Figure 34, the mean value of the estimate is: 

£[4,(/o) 1 - £>«(/)$„</)# - s„(/ 0 ) 

This is a biased estimate, being less so as the bandwidth of H(s) decreases. The variance of the estimate 
is: 


var[^(/ 0 )] = ^Si(/ 0 ) 

The variance is proportional to the square of the actual value of the spectrum. The proportionality 
constant is an important metric, highlighted by the following normalized error, and good when the bias is 
small: 


■s«(/o) JW 

The bandwidth time product, B S T , is used to compare the different transform estimation methods. 


4.6.3 Power Spectrum Estimate Using Finite Time Fourier Transforms 
The finite time Fourier Transform of the time series x (t) is: 

F y (a 0 ,t)= [_ T x(jy-^ x dx 
This is equivalent to convolution with the filter: 

h( t) = e~ j0 *> (T ' ,) 

defined for 0<t <T and where ^ = 2;r/ 0 . The bandwidth-time constant for this filter works out to be: 



The terms B s and T, and the product B S T are all constants that do not depend on frequency. 
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4.6.4 Power Spectra Estimate Using Morlet Wavelet Transforms 

The Morlet Wavelet Transform of the time series x(t) is equivalent to the convolution: 


Wy (**>.*)= l_ T x(r)h{t-z)dr 
for: 

h(t) = 4fo0*(fo t ) 
m = e~ j2m g(t) 


g(t)= 



The statistical bandwidth for the filter h(t) is: 


d _ /o 

The length of the transform is defined to be T = 6a = N c /f 0 , where <J = (^//?/2)// 0 is the standard 
deviation of the Gaussian envelope, and N c is the number of cycles of the wavelet frequency. 
Substituting, we get: 

• R fo l-2/o 

5 N c ^2nl9 N c 

The bandwidth-time constant for this filter is: 


1 


B S T= 

yl2x/9 


= 1.2 


The terms B s and T depend on frequency, but the product B S T is constant. The statistical bandwidth will 
change for different mother wavelets. The exact value has only been determined for the Morlet wavelet. 


4.6.5 Reducing the Variance of the Power Spectrum Estimate 

The variance of the power spectrum estimate is inversely proportional to the bandwidth-time product 

B S T . Increase the size of this “rectangle” or “frame” in the time-frequency plane to reduce the variance. 

Comments: 

• The time dimension T can be increased, but doing so is tricky because the statistical 
bandwidth is inversely proportional to T. The most straightforward approach (of 
increasing T and letting the statistical bandwidth change accordingly) does not 
change B S T and hence does not reduce the variance of the estimate. This is true for 
Fourier transform estimates, and it is also true for Wavelet transform estimates. 

• Averaging power spectrum estimates computed at different times increases the 
“effective” value of T. Define the total time window as T tota i = n^T . If the time 
windows overlap then n t is smaller then the number of individual estimates. The 
statistical bandwidth remains the same, and the effective bandwidth-time product 
increases to n t TB s . The tradeoff for n t T is reduced variance versus increased time to 
detect changes. 
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The statistical bandwidth can be increased, but again use averaging to increase the 
effective bandwidth-time product. Define the total frequency window as 
=n f B s> Where K f is smaller than the number of individual estimates if the 

bandwidths overlap. Combine both time and frequency averaging so that the effective 
bandwidth-time product is n t n^TB s . 

• The tradeoff for nr B s is reduced variance versus increased bias of the mean. The 

estimate of the mean is average power about the center frequency, and the lightly 
damped resonant modes will be obscured if the effective bandwidth of the estimate is 
too large. 

• A difficult case is power spectrum estimation of a lightly damped resonant mode. To 
estimate a damping ratio £ a reasonable bound for the effective statistical bandwidth 
is: 

n f B s=Cfo 

• Substitute B s =1.2 f 0 /N c for Morlet wavelets and then the center frequency / 0 
drops out, leaving: 

1.2 n f IN c =C 

• For example, if £" = .05 then the equation requires that N c /rif =24 . The wavelet 

needs to be defined with at least 24 cycles of the center frequency. The damping ratio 
restricts the freedom available in the frequency domain, and so the only way to 
reduce the variance of the power spectrum estimate is to use overlapping time 
windows. 

To summarize, the normalized error of the power spectrum estimate is reduced by time and frequency 
domain averaging, with respectively n t and n j degrees of freedom in the time and frequency domain: 


*[S**(/o)] = 


ras&xl/b)] _ 1 

S xx(fo) yj n t rij-B s T 


4.7 Time Varying Transfer Function Estimation 

A system transforms an input signal to an output signal. The innovation of the work described herein is to 
use the wavelet transform of the input and output signals to estimate a time varying frequency response. 
This is done using techniques similar to those that successfully use Fourier transforms, but now with two 
advantages: (1) the ability to estimate time variations in the system and (2) faster convergence of the 
estimate. The frequency response that is estimated is called a “time varying transfer function (TVTF).” 
The convergence time of the estimate depends on the frequency of the wavelet basis functions - faster at 
high frequencies and slower at low frequencies. 
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4.7.1 Transfer Function Estimation Using Finite Time Fourier Transforms 

In Figure 2 the open loop system is a linear time invariant (LTI) with the transfer function g(s ) . 


«(0 

g(s) 

y (0 

^ 

F u (co,t) 

Fy(CD,t) 



Figure 35. Transfer Function Estimation Using Fourier Transforms 


The frequency response is g(co ) , defined as g(s) at s = jco . Under ideal conditions the frequency 
response estimate is: 


g{CQ,t) = 


Fy(0),t ) 
F u ( a),t ) 


The “hat” indicates an estimated frequency response. The estimate is made at time t based on input and 
output data over the previous T seconds. The transforms are either Finite Time Fourier Transforms 
(FTFT), or when using sampled data, as will always be the case. Digital Fourier Transforms (DFT). The 
latter are computed using the Fast Fourier Transform (FFT) algorithm. 

The ratio of transforms works well when the input Single to Noise Ratio (SNR) of the input is large, and 
can be obtained in practice by inputs that are narrowband Gaussian noise or a sum-of-sines. 


A more robust estimate uses a smoothed estimate of the cross-spectral density divided by a smoothed 
estimate of the input power spectra density: 


g{a,t) 


S_yu 


The “tildes” indicate smoothing, shown below as an average over a frequency range: 


SccfiiVavg .0 = * F a {0i,t)Fp{(0,t)dC0 


In the digital domain the smoothing is the average of adjacent frequency bins. 

The coherence measures the relative error of the output power spectral density: 

2, |M<a>)f 

p ’ $.(«,)$„(*«) 

For linear time invariant systems the coherence is ideally one, indicating all of the output power is 
correlated with the input. Coherence less than one can be due to measurement noise, other inputs assumed 
to be zero but not actually zero, transient responses that have not yet settled, nonlinearities in the system, 
and/or time variations in the system. 

The coherence is one part of a more complicated expression for the confidence interval for g{(0 ) , see 
Ref. 27. The confidence interval decreases as the coherence gets closer to one, as expected, but just as 
important is the fact that the confidence interval decreases as n, the number of degrees of freedom in the 
estimate increases. The degrees of freedom increase as the length of the time series increases, as more 
adjacent FFT bins are averaged, and as the tapering of the time series window increase. These effects are 
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related, but basically the tradeoff is that lower frequencies, smaller frequency resolution, and smaller 
confidence intervals all require longer time series. 

4.7.2 Time Varying Transfer Function Estimation Using Wavelet Transforms 
Start with the same LTI system and compute wavelet transforms of the input and output: 


u(t) 

W u (eo,t) 


g(s ) 


y(t) 

W y (G),t ) 


Figure 36. Transfer Function Estimation Using Wavelet Transforms 


Under ideal conditions the frequency response estimate is: 


g{° } ’ t ) = 


Wyjav) 

W u (a),t) 


This ratio was used in Ref. 13 with sum-of-sine inputs. The main difference with Fourier methods is the 
dependence of the estimate on time. At the frequency (Qq define the length of the wavelet to be Tq , and 
therefore the estimate g(OJQ,t) depends on input and output data for the previous Tq seconds. The time 
dependence scales with frequency, so that at frequency o\ the estimate g(a\,t) depends on input and 
output data over the previous 7j = {(Oq I o\)Tq seconds. The time window is smaller at higher frequencies, 
hence the ability to responds more rapidly to changes at high frequencies. 

A more robust estimate uses a smoothed estimate of the cross-spectral density divided by a smoothed 
estimate of the input power spectra density. The same notation is used for the smoothed spectra: 




Syu Q-wQ 
Suu KO 


where the average is over both time and frequency: 

Seep (<»a V g - 0 = (ffll _ ab)(r _ fo) Q lW a (6),t)Wp(6),t)dtdO> 


The average frequency is used and the current time. In the digital domain the smoothing in the frequency 
domain is the average of adjacent frequencies. 


4.8 Estimating Time Varying Transfer Function Coefficients 

Transform methods are used to estimate the time varying transfer function (TVTF). The frequency 
response is estimated at many different times, and from this set of frequency responses parameters are 
estimated. One such set of parameters is the numerator and denominator coefficients of a transfer 
function. The parameters are estimated from each frequency response, and hence the parameters are time 
varying. Estimating transfer function coefficients is the subject of Appendix B. The results are 
summarized here. 


4.8.1 Problem Statement 

The estimation problem starts with input and output data: 
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Mj = input data 
yi = output data 

defined for a set of time steps, and the object is to estimate the coefficients of the z-transform: 


G(z) = 


b m Z m +--- + ^p 


_n , n-1 

Z + a n -\Z 


• + OQ 


There are many parameter estimation methods to choose from grouped into the main categories shown in 
Figure 37. 



Figure 37. Transfer Function Coefficient Estimation Methods 


Time domain methods work directly with the input and output data. Frequency domain methods start with 
a frequency response, from which the parameters of the transfer function are estimated. Markov 
parameters methods first estimate Markov parameters, which are the impulse response of the system, and 
from which the transfer function parameters are estimated. 

Mathematical tools for the parameter estimation problem include linear and nonlinear least square 
minimization, difference equation solutions, and orthogonal polynomials. Troublesome issues include 
initial conditions, sensitivity to noise, determining the system order, numerical stability, and stability of 
the estimated system. All of these subjects are discussed in Appendix B and in the references that are 
listed there. The methods included in Figure 37 overlap, and conditions are derived in Appendix B where 
the different methods give exactly the same solution. 


4.8.2 Time Domain Methods 

The difference equation from which the z-transform is derived is used to define a one-step prediction: 
h = ~(a n -iy k -i + • • • + OQy k _ n ) + {b m u k _ n+m + • • • + ) 


The objective is to minimize the weighted error of this one-step prediction: 

e 0 


T 

J -e We , where e = 




and e k =y k - y k 


The error depends linearly on the transfer function coefficients, and the solution is found by linear least 
square minimization: 


d = (WF) + Wy 
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The matrix F and vector y are created from input and output measurements, the superscript + indicates a 
pseudo-inverse, and the vector 6 contains the transfer function coefficients. A variation on this problem 
is to minimize the simulation error, which makes this a nonlinear minimization problem. 

The time domain linear least square parameter estimation problem is a classic problem in system theory. 
Iterative solutions can be used to speed calculations and to embed the estimated parameters into adaptive 
control. A nice feature is that the time domain solution does not depend on the initial conditions, and in 
particular the initial conditions do not have to be zero. Also, this method is not sensitive to constant 
offsets in the data. Time domain methods, however, are sensitive to noise, nonlinearity, data skewing and 
other practical problems, and reliability is a serious issue. We have included time domain methods mainly 
as a basis of comparison, something to do better than. A good way to increase the reliability of the 
estimated parameters is to switch to the frequency domain. 


4.8.3 Frequency Domain Methods 

The error to be minimized is the frequency response, obtained using either Fourier or wavelet methods. 
To define a frequency domain error, multiply the z-transform through by the dominator: 

(z n +a„_iz n 1 ”- + a 0 jG(z) = ^ m z m +--+ioj 

Define z,- = e^ ifl and G,- respectively as digital frequencies and frequency responses, where h is the 
sample period. The objective is to minimize the weighted error: 

J = e H We , where e k = (z£ +a n _izr 1 "'+« 0 )G J - ~(W +*"+6o) 

The error is complex, and the superscript H is the complex-conjugate transpose. The error is the 
frequency response error of just the numerator, a quantity that is not usually important, if at all, but this 
error has the distinct advantage of being linear in the coefficients. To solve the problem define F and y in 
terms from the data, and the linear least square solution takes to form: 


0 = 


Re[WF]WRe[Wy]> 

Im [WF]J [lm[Wy], 


Several variations of the frequency domain parameter estimation have been implemented in the wavelet 
analysis toolbox. These include: 


• An iterative version of the problem is defined whereby weight depends on the 
previous estimate of the coefficients and is used to define a relative error: 

W = diagO; ) , where w, = + • • • + | 

• The relative error gives equal weight across the frequency range, and in particular 
does a better job at estimating the transfer function in the frequency range where the 
gain is low. 

• To directly minimize the frequency response use the error: 

J = e H We , where e k =G k ~[b m Zk +-+fto)/(z£ +a n -iZk~ 1 "‘ +a o) 


• The error now depends nonlinearly on the parameters, and an iterative solution is 
required. Use the linear solution, or even better the iterative linear solution as the 
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initial guess. The diagonal weight with w,- = |G ; - j 2 turns the error into a relative 
error. 

• The coefficients of a Laplace transform can be directly estimated, where and G, 
are respectively the analog frequencies and the frequency response. The large 
dynamic range of the parameters can cause numerical stability, and this problem is 
alleviated by using normalized frequencies, coja and by converting the 
numerator and denominator polynomials to orthogonal polynomials. 

• A delay can be included in the problem, z~ d in the digital world and e~ ST in the 
analog world. The delays can be estimated iteratively and/or as part of the nonlinear 
problem. 

4.8.4 Markov Parameter Methods 

The Markov parameters for digital systems are the digital impulse response. The basic idea is to estimate 
the Markov parameters from the input and output time series, and then use the parameters either to 
determine the transfer function coefficients, or via the Eigensystem Realization Algorithm (ERA) 
determine a state space system. Advantages of the Markov parameter methods are that they can be used to 
determine the system order, they directly estimate state space systems, and they have been shown (by us 
and others) to work well with high order (50 and above) systems. 

The difficult part of this method is finding the Markov parameters. The parameters are sensitive to the 
initial conditions, to noise, and to offsets in the data. One can even say, very sensitive. One approach to 
reducing this sensitivity (Ref. 24) is to use the time domain parameter estimation problem as a first step, 
from which the Markov parameters are determined. Another way to reduce sensitivity (Ref. 25) is to start 
first in the frequency domain, and to use the transfer function coefficients so estimated to determine the 
Markov parameters. 

As part of this study we have implemented and further developed a method whereby wavelet transforms 
are used as an intermediate step in finding the Markov parameters (Ref. 26). The wavelet transforms of 
the input and output time series are used to estimate the Markov parameters in the transform domain. 
Selective use of the transform coefficients reduces sensitivity to noise and to offsets. Estimating the initial 
conditions and then subtracting off the forced response reduces sensitivity to non-zero initial conditions. 
The original Markov parameters are recovered using the inverse wavelet transform. The combined 
method is called the Wavelet Eigensystem Realization Algorithm (WERA). The Markov parameter 
estimation methods and WERA are further discussed in Section 5 and Appendix B. 

4.8.5 Summary 

We have used frequency domain and WERA parameter estimate methods extensively in this study. Many 
examples are presented in Section 6. 

The number of variations in the parameter estimation methods quickly becomes a burden to the user and 
automation is needed. The variations of the frequency domain estimation method that have been most 
productive, and automated, are briefly summarized here. Laplace transform coefficients are estimated 
including a parameter for delay. The linear least square solution is used as the initial guess, followed by 
several iterations where the relative error is minimized, followed by several iterations with different 
delays used to obtain a starting guess of delay, and finished with nonlinear minimization. 

Any method works well for low order problems using data generated by simulation, but the combined ill- 
effects of “real world” data makes single-step linear least square methods unreliable. The alternative is to 
“get close,” and finish with nonlinear minimiza tion. Even better, and this option can be switched on if 
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computation time is not an issue, is to use many starting guess, with different order systems, and other 
variations, and then choose the global minimum. 

4.9 Analysis Example (F-15 Active Model) 

Time varying transfer functions (TVTFs) are demonstrated using a model of the F-15 Active aircraft. A 
change is made to the longitudinal dynamics by suddenly inserting an extra delay. The exact frequency 
responses are known before and after this change, and which are used to compare the estimated frequency 
responses using wavelet methods. A model of a pitch SCAS is shown in Figure 38. The SCAS is needed 
because the open loop vehicle is unstable. The input S e is the effective elevator input made by combining 
stabilator, canard, and thrust vector inputs. Ideal actuators and sensors are used, and the aircraft dynamics 
use a short period approximation. Open and closed loop transfer functions are shown in the Figure 38. 
The delay is modeled using a second order Pade approximation. Of particular note is that the 120 msec 
delay results in a lightly damped closed loop poles at 10.2 rad/sec with a damping ratio of 0.0868. 

Simulation results are shown in Figure 39. The closed loop input is the output of a bandpass filter of 0.1 
to 20 rad/sec driven by unit intensity white noise. The run length is 60 seconds with 3 seconds of zero 
input at the start and end. The sample period in the simulation is 10 msec. The presence of the lightly 
damped mode is apparent in the pitch response in the second half of the simulation. 

Given the time series the objectives are to estimate the time varying frequency response and to detect the 
change in delay. The TVTF is shown different ways in Figure 40: 

Part a) contains the exact frequency responses, used to verify the estimates. Notable features are 
the peaked magnitude response and the resulting sudden drop-off of phase. The time for the 
magnitude peak to cross the 0 dB line is used as the detection time. 

Part b) is a 2D plot of the TVTF, showing 10 seconds of data ending at 37 seconds. The last 
frequency response is the bold dotted line, and the previous frequency responses fade to 
white. The peak in the magnitude is seen to build up, and the phase changes from a gradual to 
a sudden increase. The coherence drops off when the change in delay occurs. 

Part c) is a 3D plot of the same TVTF. The magnitude and phase changes are visually apparent, 
but numerical results are better obtained from the 2D slices of this figure. 

How long does it take to detect the change in delay? The magnitude peak crosses the 0 dB line in 7 
seconds. The detection time depends on how the TVTF is computed, and different methods and 
parameters are shown in Figure 41 and summarized in Table 3. The left hand column in the figure is the 
3D display of TVTFs looking almost straight down the frequency axis, a view that highlights the 
magnitude change. The right hand column is a single frequency versus time, from which the detection 
times are obtained, varying from 5 to 15 seconds. Part a) of the figure uses the same TVTF parameters as 
the first part of the example. The detection time is increased in Part b) by using fewer cycles of the Erlang 
wavelet and by averaging fewer adjacent times. The variance of the frequency response estimate increases 
accordingly. Parts c) and d) use finite time Fourier transforms with sliding windows, with window lengths 
of 60 and 5 seconds. The smaller window matches the 5 second detection time. 
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Table 3. F-15 Active Example Detection Times 


Method 

Parameters 

Detection Time 

Erlang wavelet 

5 cycles, 21 adjacent times averaged 

7 secs 

Erlang wavelet 

12 cycles, 120 frequencies log spaced from 0.1 to 30 rad/sec, 3 
adjacent freqs averaged, 300 transforms one each 0.2 secs, 41 
adjacent times averaged 

5 secs 

Finite Time 
Fourier Transform 

Frequency smoothing with adjacent frequency ratio of 1.05 and 
at least 3 bins averaged, 41 adjacent times averaged, 60 second 
sliding window 

15 secs 

Finite Time 
Fourier Transform 

21 adjacent times averaged, 5 second sliding window 

5 secs 
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Open Loop: 

q -21.9(0.993) 
S e ~ (-1.8X3.53) 
K q =- 0.435 
^ =-0.435x3.5 


Closed Loop: 



-21.9(0.993) 

with 7 = 0 

(1.55)(3.39)(6.32) 

: 21-9(0.993)[0.866,28.9] t-(u2 

(1.4)(3.46)[0.0868,10.2](54.6) 


Figure 38. F-15 Active Pitch SCAS 



.Al J > j 1 1 I 

0 1 0 20 30 40 50 60 


Seconds 


Figure 39. F-15 Active Simulation (the delay changes from 7 = 0 to 7 = 0. 12 at 30 seconds) 
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c) Slow Detection (Finite time FFT, 60 second sliding window, 21 time bins averaged, 15 seconds to 0 dB line) 



d) Fast Detection (Finite time FFT, 5 second sliding window, 21 bins averaged, 5 seconds to 0 dB line) 
Left plots are 3D Theta/dec magnitude plots; right plots are 2D displays of a single frequency versus time 

Figure 41. Detection Time Example (F-15 Active with sudden additional delay) 
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4.10 Analysis Example (Large Transport Fixed Base Simulator Data) 

TVTF estimation, transfer function coefficient estimation, and stability metric estimation are all 
demonstrated in this example. The data is from a hardware-in-the-loop manned flight simulator for a large 
military transport, Run 69 from the LOCATS database. The experiment used to collect this data is 
described in Volume II of this report. 

The fixed base, manned simulator is represented in the Figure 42 block diagram. The pilot inputs are 
DLON and DLAT, the longitudinal and lateral stick positions in inches. There is a turbulence input, 
turned on for this run, and there is also an auto-throttle loop turned on for this run. The auto-throttle loop 
is an internal feedback inside the main block. Here the interest is the closed loop response from DLON to 
THE, the longitudinal stick to pitch attitude. The simulator is 6 DOF nonlinear, with a complete 
aerodynamic model and nonlinear actuator models, the actual flight control computers, and a 
representative stick. The stick has a deadband, friction, and preload that is prevalent primarily in the 
lateral axis (see Volume II of this report). We have not tried to extract a linear model from the simulator 
documents, and so we do not have a “truth” model for this example. The flight condition for this run is 
lightweight cruise. 

Time series data from this run is shown in Figure 43. The pilot is performing a pitch attitude capture and 
hold (PACH) task. At 27 seconds into the run the pitch SCAS is turned off, changing the controlled 
element from a well damped, closed loop vehicle to a lower bandwidth, more lightly damped, open loop 
vehicle. In addition, throughout the ran extra delay is included in the pilot input, in order to make the 
piloting task more difficult. 

The TVTF is computed using the Matlab Wavelet Toolbox developed by us as part of this study. The 
wavelet is the Erlang wavelet with 5 cycles, computed every 0.3 seconds, with 200 frequencies log- 
spaced from 0.1 to 20 rad/sec. Smoothing is performed on 41 adjacent times and 11 adjacent frequencies. 
The TVTF is shown in Figure 44, which has the magnitude, phase, and coherence. The change in the 
TVTF at 27 seconds is visually not very apparent, making this a harder case to analyze. The change is 
easier to see on a color display, where the color changes show that the open loop vehicle has a more rapid 
roll-off in both magnitude and phase. Another “feature” is the ridges in phase above 10 rad/sec, indicating 
a large variance in the phase estimate, and due mainly to the lack of input power above 10 rad/sec. 

The example continues with the estimation of three stability metrics: 

phase - phase bandwidth, the frequency at which the phase crosses -135 degrees. A pure gain 

pilot closing the loop at co phase w iH result in 45 degrees of phase margin. 

00 gain = g^ 11 bandwidth, the frequency at which the magnitude is 6 dB above the magnitude at 
80 , where tf^go is the frequency where the phase crosses -180 degrees. A pure gain pilot 
closing the loop at (O gain will result in 6 dB of gain margin. 

T p = phase delay, defined as one-half the slope of the phase between the G\ go and 26^g 0 

frequencies. Large phase delays indicate a rapid phase roll-off, which in turn results in a 
higher pilot workload. The extra phase roll-off is due to pure delay, higher order dynamics 
that act like an effective delay, and nonlinearities such as rate limits. 

Each of these metrics can be estimated from a frequency response by searching for magnitude and phase 
crossovers, and the toolbox contains options to do just that. The advantage of using the “raw” frequency 
response is that a parametric model of the controlled element is not needed. The disadvantage is that the 
variance in the frequency response estimate can result in large errors in the estimate of the metrics, in 
other words, the stability metrics are more sensitive than the frequency response. This is particularly a 
problem for the gain bandwidth and the phase delay, because they are based on crossover frequencies 
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above 4 rad/sec, auu therefore up the in frequency image where the input does not have much power and 
the coherence is low. 

To reduce the sensitivity of the stability metrics, the raw frequency responses are used to estimate 
coefficients of a Laplace transform, and then the stability metrics are estimated from the frequency 
responses of this fitted Laplace transform. This process is demonstrated in parts a) and b) of Figure 45; 
where the raw “TVTF” and “Fitted” frequency responses are plotted before and after the change in the 
pitch SC AS. The frequency response of the fitted Laplace transform is seen to smoothly cut through the 
bobbles in the raw frequency response. 

The stability metrics are computed for each time slice of the TVTF and plotted versus time in part c) of 
Figure 45. A significant reduction in the phase bandwidth occurs after the pitch SC AS is turned off at 27 
seconds. We have not automated detection times, but a plausible detection time of 13 seconds for the 
phase bandwidth change is overlaid on the plot. The gain bandwidth and phase delay each have 
significant transient changes when the pitch SCAS is turned off, but then settle back to their original 
values. 

How good are the estimated stability metrics? This is a difficult question. We do not have “truth” models 
available to us, but one way to check Figure 45c is to compare the estimates with values obtained from 
longer sections of the data. The stability metrics estimated this way are listed in Table 4, using 25 seconds 
of data before the change, and 60 seconds after. There is a good match with the time varying metrics in 
Figure 45c. 


Table 4. Estimated TF and Stability Metrics for LOCATS Run 69 



With Pitch SCAS 
(0 to 25 seconds) 

Without Pitch SCAS 
(30 to 90 seconds) 

Estimated tf 

9 _-5.64(-11.3)e-°- 198s 
S Cc ~ (1.06)[0.536,5.54] 

6 -2.04(-7.52)e' 0138s 

S 6c ~ [0.614,1.1](4.92) 


' ^ i v|4 

Mwt its* 

' i' 1 ‘‘ ' * *' , V 

Gigain [rad/sec] 

1.3 

1.2 


HiiSII SiliSMMl I; ailllll 

. -kr: if ■ ' ■:§ 

igftalW "WWB 1 W- • 

r p [sec] 

0.32 

0.33 


Significant 

change 


Significant 

change 
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5. ERA-BASED SYSTEM IDENTIFICATION USING WAVELETS 


5.1 Introduction 

The experimental identification of physical vibration modes and mode shapes can be done with impulse 
response functions that are extracted from measured vibration records. In order to extract these impulse 
response functions, the Fast Fourier Transform (FFT) has often been used in conjunction with repeated 
data filtering and windowing (Ref. 27). These techniques require input signals that are rich enough to 
excite frequencies of interest - this does not appear to be the case with wavelet analysis. Moreover, with 
its more intuitive decomposition of data, wavelet analysis allows identification of time-varying system 
parameters. 

The system realization, based on a first-order state space model, can be represented as: 

x(t) = Ax(t)+Bu(t) 
y = Cx(t)+Du(t) 

In the time domain, the solution at time t n to the above equation can be expressed as: 

y( t n)= f^h(t n -z)u(T)dt 

where h(t) is the temporal impulse response function. This convolution formula can be expressed in 
matrix form by: 

Y = hU 

In this equation, Y represents the output matrix, U is the input matrix, and h is the time-domain impulse 
response matrix. Once h is known the output of our system can be determined for any arbitrary input. An 
accurate extraction of h(t), often referred as the Markov parameters, will identify a system (Ref. 28) since 

h(t) = Ce M B 

One could try to obtain h(t) directly by applying a unit impulse input u(t). In this case, y(t) would 
theoretically be identical to the desired h(t). However, this is practically infeasible. Looking at the 
equation Y — hU , if the input signals are not rich in frequency content, or the sampling size is too large, 
U can become ill-conditioned and the corresponding impulse response function cannot be computed 
accurately. Moreover, the computations associated with h(t) can be intensive. For these reasons, FFT- 
based extraction of the impulse response function is widely used (Ref. 27) since it has high computational 
efficiency and reasonable robustness provided the input data is rich in frequency content. However, if the 
input load u consists of only a single or a few frequencies, the temporal impulse response data tends to be 
erratic and badly conditioned. Wavelet analysis appears to offer a more robust alternative. 

5.2 Computational Technique 

5.2.1 Wavelet Theory 

The wavelet transform allows any arbitrary signal /fy) to be decomposed into an infinite summation of 
wavelets at different scales according to the expansion (Ref. 29): 

w=iZ c « w < 2,x -‘) 

The W(2fx-k) functions are the wavelets and provide a local basis along the time axis. To see how 
wavelets can be generated from the so-called dilation equation and their relation to the scaling functions 
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(p(x), the reader is directed to Ref. 22. Because of the way in which the wavelets are defined, when j is 
negative, the wavelets W(2x-k ) can be expressed as a sum of terms like <p(x-k). The corresponding 
wavelet transform can then be expressed as follows: 


y=0 k=—oo 


In this report, the Daubechies coefficients (Refs. 30 and 31) are used to generate these wavelets. Figure 46 
shows a family of Daubechies’ wavelets. Note that db2, which is used in this analysis, spans a bit less 
than 3 units over the x-axis. The Daubechies’ family of wavelets satisfies two crucial requirements: 1) 
orthogonality of local basis functions, and 2) second or higher-order accuracy, depending on the dilation 
expression adopted (Ref. 32). 



In order to use the wavelet transformation in practical applications, a way to define a discrete version of 
the transformation must be found. For this purpose, the range of the independent variable x is limited to 
the unit interval [0,1), and a wavelet series expansion is performed over that interval (Ref. 33). A 
complication arises since some of the wavelets W(2 i x-k) overlap the edges of the interval. For this reason, 
it is convenient to assume ihaXfix) is one period of a periodic signal exactly repeated in the adjacent unit 
intervals. Note that with the D4 wavelet family W(x) spans almost three units. Over the interval [0,1) there 
are contributions from three bases: from the first third of W(x), from the middle third of W(x+1), and from 
the last third of W(x+2). This is equivalent to W(x) being wrapped around the unit interval. Thus the 
wavelet expansion of f(x) in the [0,1) interval can be written as: 


f(x) = a 0 <p(x) + affix) + \a 2 


W(2x) 
W( 2x-l) 





«7 


W(4x) 

■ W(4jc— 1) 

■ W(4x-2) 
W(4x-3) 


+ ... 


+ a 2j+k W(2 J x-k) + ... 


TR 1341-1 


54 





The coefficients ai, ai, as, a 4 , ... give the amplitudes of the contributing wavelets (after wrapping) to one 
cycle of the periodic function in the [0,1) interval. Because of orthogonality conditions, the general 
wavelet transform coefficients can be found by 

1 1 

a 2 '+* = 2> J/MW( Vx- k)dx , a 0 = $f(x)<p(x)dx 
0 0 

The discrete wavelet transform (DWT) is an algorithm for computing the above equations when /( a:) is 
sampled at equally spaced intervals over [0,1). As stated before, it is assumed here that ./fa) is one period 
of a periodic signal and that the scaling and wavelet functions wrap around the interval [0,1). A 
remarkable feature of the DWT algorithm is that there is no need to compute <p(x) or W(2’x-k) explicitly. 
An Matlab-based implementation of this DWT algorithm, found in Appendix 7 of Ref. 33, was developed 
by Mallat, and is often referred by as the Mallat’s Pyramid Algorithm. 


5.2.2 DWT-Based Extraction of the Markov Parameters 
The DWT method starts with the convolution integral, 

1 

y(t R )= \h(t n - r)u(x)dr = §h(0)u(t n -9)dd 

-00 0 

Note that h( 6) is the temporal impulse response function. The impulse response function is expanded in 
terms of the wavelet basis functions for the entire time interval, 0 < 6 < 1 ; 

h (&) = ur + 2 j e+k) 

j * 

where the h DWT terms are the expansion coefficients. For the DWT characterization of u(t n -6), first u(0) is 
reversed in time to obtain u( -9), then it is shifted toward the positive time axis by an amount t n . Following 
this, u(t n -0) can be expressed as 

u(tn-9) = Mo dbt + X 9+k) 

< i 

Substituting and making use of the orthogonality conditions, yields the following (Ref. 33): 

y(t n ) = h Dwr u Dwr (t n ) 


For the entire data sample, the inputs and outputs are arranged in the form 

Y _ j^DWTjjDWT 


Solving for h DWT (Ref. 32), 


^DWT _ y jj DWT 7 (jj dwt ijDWT T yl 


The desired temporal impulse response data is finally obtained by taking the inverse wavelet transform of 
h DWT . (See Ref. 33 for details on how to implement the inverse wavelet transform.) 

h(t) = IDWT (h Dvr ) 

It is important to note that, in the h Dwr equation, the term u Dm <jj DWT f j s invertible. This is because the 
wavelet transform coefficients consist of a set of orthogonal local basis functions. This represents a 
significant improvement over direct time-domain methods - they find the Markov parameters by h=U' 1 Y. 
Unfortunately U is often ill-conditioned; and one is forced to take its pseudo-inverse instead. With FFT- 
based methods, an ill-conditioned V matrix also negatively affects the low-mode or static deformation 
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amplitudes and phases. The proposed wavelet transform does not induce any rank-deficient basis 
function. 


5.2.3 Response Decoupling 

The limits of the convolution integral, y(t n )= h( t n -x)u(f) dT , can be changed to 

y(t n )= I" h(t n -r)u(T)dr if h(t) is defined to be zero for time less than zero. This then represents the 

forced response of a system to an input u(t) , where all initial conditions (at t 0 = 0) are zero. When a 
data sample is taken after system start-up at t 0 > 0, the convolution integral is generally no longer valid, 

as the sample usually introduces non-zero initial conditions y(t 0 ),y(t 0 ), etc. Thus the general response 
consists of a forced component and free component, 

y(K)=y f orced( t n)+y f ree( t n) 

Using a state-space representation, the free response can be written as 
The convolution integral can then be written as 

y forced (.K ) = f M t n -T)u(T)dT = ) 

The above equation can be rearranged so that 

hit , t ) * u{t u ) = y(t n )— Ce ( ‘"~‘ o)A x h 

Discretizing the free response with a sampling period of T (Ref. 34), 

T4 T T 2 , 

6 — /- 1 — Ah A +... 

1! 2! 

For a sufficiently small T , only two or three terms need to be carried out and the free response equation 
can then be written using the difference equation 

x 0 (k+ l) = e TA x 0 (k), 


y M ,(k + l) = Ce TA x 0 (k) 


The discrete wavelet transform of the impulse response function can then be written as 

h DWT = y forced U DWTT (U DWT U DWTT r\ 


where 


y forced (V = yobs ( k ) ~ Ce™ X Q (k) 

Finally, the impulse response function in the time-domain is computed by taking the inverse discrete 
wave transform of the above equation, 

h(t) = IDWT{y forced udwt^jjDwTjjowtY } 
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Computation of the system parameters is done with two methods that make use of the observed impulse 
response h(t). The first method employs the Eigensystem Realization Algorithm (ERA) method 
(discussed in Section 5.5) that uses least squares to estimate the discrete state space realization of the 
observed impulse response. The second method takes the Fourier transform of h(t ) , 


r n~h 

H{(o) = jh(t)e~ iaM dt 
0 




H(a) = k ^h(JcT)e~ iakr T 

1=0 

Looking at the forced response equation, the unknowns are A, C, and * 0 . Any single-input, single- 
output system that has a state-space model has a rational, proper transfer function of the form 

yQ) _ y+ V 1 *— ft. 

u(s) s n + H — a n 

If bo * 0, it is convenient to divide the denominator into the numerator to rewrite as 

fif— , 

u(s ) s" + 1 H — a n 

where 


c, =b i -b 0 a i , i = !,•••« 


In order for the states x to be observable from the output y, the state-space equations are written in 
observable form, i.e. 


d_ 

dt 




"0 -a n 

V 




V 

x 2 

= 

1 ~ a n-\ 

*2 

+ 

<Vi 

u, y = [0 • • • 0 1 

*2 

_ *n_ 


1 ~ a i . 



. c i . 




+ b 0 u 


The identification process is initiated by assuming initial values for the poles and zeros of the system’s 
transfer function, which in turn determines the initial state-space representation. From the above equation 
y = x n + b Q u , and the states x n ^ , x n _ 2 ,---,x l can be solved from the (n-f) equations available from the 

A and B matrices. Thus the initial states xo are estimated based on the initial condition of y (i.e., the first 
value of each data sample) and its higher derivatives. This will allow an estimate of the free response to 
be subtracted from the observed response, and the resulting impulse response function is compared with 
the impulse function arising from the estimated A and B matrices. This comparison is conveniently done 
in the frequency domain, where a least-squares fit of the observed impulse response to poles and zeros is 
performed. 


5.2.4 Example Results 

A simulation was conducted using a sum-of-sines input forcing function (7 frequencies, 10 rad/sec 
bandwidth), where the magnitude of the sine wave amplitude tapered with increasing frequency. The 
input/output transfer function to be identified was 
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yC?) _ (s + .5) _ $ + .5 

u(s ) (j + 3X-y + 5) 5 2 +8j + 15 

Data was sampled at 100 Hz, and a time window of 2.56 seconds was used. A D4 Debauchies wavelet 
with 7 levels (2 7 by 2 7 input matrix U DWT ) was also employed. Figure 47 compares the observed and 
simulated impulse response functions, where the initial estimate of the system poles and zeros matched 
the simulated values. The data sample was taken 20 seconds into the simulation run. 



Figure 47. Comparison between Observed and Simulated Impulse Response Function 

In Figure 48 the frequency response of the two impulse functions is shown. The observed computation is 
a near-match with the simulated response. 
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In Figure 49 the initial estimates of the zero and two poles were placed 0.5 rad/sec higher than actual 
(which affects the free response that is subtracted from the observed response). Essentially, the observed 
response precisely indicates the simulated zero and poles, showing robustness to zero and pole estimate 
error. What this indicates is that whenever an update is performed with a new data sample, the zeros and 
poles computed for the previous data sample will likely be a suitable initial estimate for the update (i.e., 
the solution is convergent). 



Figure 49. Comparison between Observed and Simulated Frequency Response with Initial Zero and Pole 

Estimates Shifted 0.5 rad/sec Higher than Actual 

5.3 Estimation of Pilot Describing Function Parameters 

Using the discrete wavelet transform techniques described above, estimates of time-varying pilot 
describing function parameters can be made. To represent a transfer function in state-space form, the 
transfer function must be realizable (i.e., the order of the numerator must be no higher than the 
denominator’s order). Assuming that the pilot’s describing function Y p takes the form of lead 
compensation and gain, Y p (t) = K p ( t)(s + z(t )) , it then becomes necessary to run the pilot stick output 

through a filter to create a pseudo, realizable transfer function Y p . Experimenting with a first and second 

order filter, it was determined that a second order filter yielded the best results. Furthermore, a natural 
frequency tq, chosen well above the pilot’s zero location and a damping ratio £ above critical damping 
provided good results. Figure 50 illustrates the filtering process, where the filter parameters chosen were 
(Da = 15 rad/sec, and 1. 


Pseudo-Pilot, Y p ’ 



Figure SO* Filtering of Pilot Output to Produce a Realizable Transfer Function 
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A simulation was created where the controlled plant was a second order system (64 = 1 rad/sec, and = 
1). The pilot’s describing function parameters were changed step-wise at 10 seconds and 20 seconds such 
that the open-loop crossover frequency ( 04 ) changed step-wise as shown in Table 5. 


Table 5. Pilot Describing Function Parameters 


Time 

K p 

z 

a 4 

t <10 

4.46 

3 

5 

10 <t <20 

3.16 

1 

3 

2Ckt<30 

4.46 

3 

5 


Figure 51 shows the components of the simulation. The input to the pilot transfer function is a sum-of- 
sine waves generated at 100 Hz. A time window of 1.28 seconds was used for the discrete wavelet 
computations, and parameter values were updated at 10 Hz. In this simulation the plant’s parameters are 
assumed rather than estimated for the computation of 64 . 
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Figure 51. Simulation Components 

Figure 52 shows the actual and estimated pilot parameters. At 10 seconds the estimate of K p is seen to 
briefly rise before rapidly decreasing, arriving at a stable value approximately 2 seconds later. At 20 
seconds K p (estimate) immediately increases and arrives at a stable value approximately 1 second later. 
Estimated values of z achieve stable values at roughly the same times as the estimates of K p , but at 10 
seconds z (estimate) immediately decreases. 
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Figure 52. Time-Varying Pilot Describing Function Parameters 

In Figure 53 the estimate of is compared with the actual values - there is good agreement between the 
two. As with the pilot describing function parameters, a decrease in actual parameter value requires 
approximately twice the time required to achieve steady-state compared to when the parameter 
experiences the same increase in absolute value. 
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In Figure 54 the estimated phase margin matches well with the actual values. 



5.4 Time Delay Identification 

5 .4. 1 Time Domain Methods 

Frequency domain methods for determining gain response of an element generally yield well-behaved 
results. However, the phase response computed using the same methods tends to be much more spurious, 
making stability analysis difficult. When pure time delays (or effective pure time delays arising from 
high frequency dynamics) are involved, time domain methods appear to be a promising alternative to 
frequency methods for identifying phase loss due to time delays. 

Figure 55 represents the open-loop pilot response during a compensatory tracking task. In Figure 56 the 
error is modeled to be a sine wave, and the pilot is modeled as a pure time delay. 


Error 


> 


Pilot 


Stick 

► 


Figure 55. Open-Loop Pilot Response 


5.4.2 Cross-Correlation Method 

One of the methods explored for measuring the time delay was cross-correlation, illustrated in Figure 57. 
Within a give time window (containing an integer number of cycles), cross-correlation is computed. The 
stick signal is then shifted in time (the error signal remains fixed) and the computation repeated. The time 
delay estimate is the shift corresponding to the maximum cross-correlation value. As the time window 
progresses along the two signals in time, the maximum cross-correlation will correspond to varying time 
shifts (for a constant simulated time delay). 
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Figure 56. Pilot Modeled as a Pure Time Delay 




Figure 57. Cross-Correlation Technique 


The result is an estimate that oscillates about a mean that is lower than actual (see Figure 58). If the time 
window is lengthened to include more cycles, the oscillation reduces and the mean improves, but there is 
a tradeoff with resolution. 
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Figure 58. Bias and Oscillating Estimate Using Cross-Correlation 

A way to improve the time delay estimate while limiting the window length to one cycle of the forcing 
function is to take the windowed data for any given point in time and concatenate the data (i.e., attach 
back-to-front) an arbitrary number of times. Thus a synthetic signal can be created that is of sufficient 
length for cross-correlation to yield a smooth and accurate estimate. However, this only is successful if 
the original window contains (approximately) an integer number of cycles of the error signal, and if two 
or more discrete frequencies are captured in this signal. This imposes four conditions: 1) the error signal 
must be composed of a sum-of-sine waves; 2) the error frequencies cannot be simply non-harmonics of 
one another - at least two frequencies must nearly fit inside the chosen time window of the and the time 
window; 3) one or more filters must be employed to pass only the integer-cycle frequencies; and 4) the 
time window cannot be arbitrarily selected, as it must accommodate at least two of the sine error 
frequencies. These four limitations greatly restrict the utility of this method, in terms of experimental and 
operational environments as well as interoperability with other analysis methods. 

5.4.3 Least Squares Method 

A technique that offers considerably more flexibility makes use of least squares, shown in Figure 59. 
Within a given time window the sum of the squared differences between the error and stick signals is 
computed. The stick signal is then shifted in time (the error signal remains fixed) and the computation 
repeated. The time delay estimate is the shift corresponding to the minimum squared difference 
summation. 

Matlab was used to verify this time delay estimation method using an error signal composed of a sum-of- 
sines, shown in Figure 60. A time window of 3.7 seconds yielded a good balance between performance 
and resolution for the given forcing function. Using a window less than 3.7 seconds gave an increasingly 
noisy estimate. It was observed that the estimate suffered if frequencies lower than 2jc/(time window) 
rad/sec were not filtered out, as well as frequencies higher than approximately 1/10 of the sampling rate. 
Thus the error and stick signals were band-passed within these two bounds. It is suggested that for an 
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actual closed-loop system the time window is chosen based on the open-loop crossover frequency (tOc), 
Time Window * 2rc/(O c , since crossover defines the region that most affects performance. 



Figure 59. Least Squares Time Delay Estimation 



Figure 60. Sum-of-Sine Waves Used for Least Squares Verification 

Three time delay conditions were simulated: 1) constant (no variation over time), 2) step changes at 
discrete points in time, and 3) sinusoidal variations over time. Steady-state performance is seen to be 
excellent in Figure 61, and estimation of discrete jumps in time delay in Figure 62 is likewise excellent. 
Figure 63 shows estimation of dynamic variations of time delay to be very good, where a shift due to the 
time window clearly discernible. Note in Figure 63 there is very little gain reduction (forcing function 
frequency is lcycle/10 seconds). 
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Run Tims (sac) 


Figure 61. Simulated Constant Time Delay (Time Window = 3.7 seconds) 



Run Time (sst) 


Figure 62. Simulated Step Time Delay (Time Window = 3.7 seconds) 



Run Time (ssc 

Figure 63. Simulated Sinusoidal Time Delay (Time Window = 3.7 seconds) 
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5.4.4 Time Delay Estimation Using Inverse Transfer Function Method 

When the bandpass filter and the estimated system model does not take into account initial conditions, the 
time window must be large enough so that the transients arising from zero-initial conditions are no longer 
a factor. By taking into account initial conditions in the filter and system model, the time window can be 
appreciably reduced. Figure 64 shows the conditioning processes for the system input and output signals, 
where the system output is run through the inverse of the estimated system to give a pseudo-input that 
ideally should match the actual input except for a pure time delay. A confidence measure is computed by 
taking the linear correlation of the system input with the pseudo-system input. 

Input to 



Figure 64. Processes Used for Estimating Operator Pure Time Delay 

Figure 65 shows a Matlab-Simulink model for varying pilot time delay using low-passed white noise. 
This model results in a pure time delay that changes over the entire time window that is used to compute 
the time delay, so that there will always be a degree of uncertainty associated with this measurement. A 
sum-of-sine waves signal was run through a second-order system (first-order lead) having the time- 
varying pure time delay, and the results are shown in Figure 66. In Figure 67 step changes are introduced 
in damping, natural frequency and gain, and the exact values of these parameters are used in the 
calculation of equivalent time delay. 
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5.5 The Wr.RA Method for Parameter Identification 
5.5.1 Computational Procedures 

The discrete Wavelet transform/Eigensystem Realization Algorithm (WERA) mnning time method 
assumes the system order and constructs from this a discrete state-space model based on an initial model 
estimate. Using this model, the state initial conditions are computed and the free (unforced) solution 
calculated for the length of the measurement window. This free response is then subtracted from the 
observed response, leaving the forced response. This is done because the convolution integral is valid 
(for practical applications) only when the initial conditions are zero. Obtaining the forced response 
allows use of the convolution integral in conjunction with the discrete wavelet transform. This produces 
the impulse response (Markov parameters), which is used by the ERA to compute the numerator and 
denominator of the system whose order is specified. This method works well for identifying key, but not 
all, parameters of a second-order system. The remaining parameters are obtained using time-domain 
methods. 

The following aircraft short period (SP) approximation was used to model the pitch rate response 
dynamics of the aircraft model used in the LOCATS simulation evaluation: 

to = K (* + z) 

S e (s) (s 2 +2go) n s-ta) n 2 ) 

The WERA method was used to obtain the Bode gain and natural frequency by: 

• Selecting a window length based on the current natural frequency estimate. As the 
natural frequency decreases the window length must increase for satisfactory 
identification. 

• Lowpass filtering the input/output (I/O) signals (7 rad/sec) based on the range of 
frequencies the short period approximation is valid over. Identification of the pitch 
dynamics using a static version of the WERA method (where the initial conditions 
were in fact zero) yielded dynamics that departed substantially from the SP 
approximation at frequencies above 10 rad/sec, due to stick, actuator, and control 
augmentation. 

An impulse response of the state-space estimate using ERA was produced, and this was compared to the 
observed impulse response (obtained via the DWT). The differences between the two were squared and 
normalized, and the inverse was used to weight how much the previous estimate could be incremented in 
the direction of the currently computed parameters. 

The zero location of the SP approximation was computed in a similar fashion, except that the output 
response was filtered using a transfer function whose numerator was the estimated denominator of the 
system (thus canceling it out). The second-order denominator was given a natural frequency above the 
lowpass frequency (10 rad/sec) to separate the zero and natural frequency dynamics. 

The effective time delay of the system was computed using the following steps: 

• Bandpass the I/O, (0.85 to 10 rad/sec) using a first-order butterworth filter 
constructed using a state-space model of the filter and then computing the initial 
conditions of the filter states. This minimizes the transients that occur due to 
filtering, thus reducing the window length that is required to identify the time delay. 

• Construct a transfer function that is the inverse of the assumed system model, and 
make it realizable by convolving the denominator (which is first-order) with a high- 
frequency pole (20 rad/sec). A state space representation of this transfer function is 
constructed, and the bandpass-filtered response of the aircraft (pitch rate) is fed 
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through this system using computed initial conditions. The bandpass-filtered input to 
the aircraft, stick position, is run through a first-order transfer function whose 
denominator is the same high-frequency pole (20 rad/sec) mentioned above, once 
again using initial conditions. 

• The conditioned output is scaled with the conditioned input using the ratio of the 
maximum values of those signals observed within the time window (3.5 seconds). 

The amount that this ratio can change from one update to the next is bounded, so as 
to minimize perturbations caused by sudden system parameter changes. 

• The output is shifted in time and compared with the input signal, and the time shift 
associated with the minimum sum of the squared differences corresponds with the 
time delay estimate. 

• A linear correlation is computed between the shifted input and output signals, and 
used to weight the amount by which a time delay estimate can be incremented. 

The damping of the SP approximation is computed by constructing a discrete state-space model of the 
system, and incrementing damping values over a limi ted range. The damping producing the minimum 
sum of the squared differences (between the observed and trial response) is selected. 

The roll rate response dynamics of the simulator aircraft model were modeled using a first-order 
approximation along with an effective time delay: 

fcs) K ,_ c 
( s + P ) 

The WERA method was used to compute both the gain and break frequency in a single step (the I/O 
signals were lowpass-filtered at 15 rad/sec), and the time delay was computed the same way as for the 
pitch rate response. 

When there are relatively prolonged periods of quiescence in the input, the identification process 
degrades. Rather than depend on metrics such as linear correlation to indicate when this has occurred (by 
which time the identification results are already deteriorating), the stick activity is measured so as to 
anticipate poor identification conditions. To do this, the low-frequency gain of the system is computed 
based on current parameter estimates, and multiplied by the standard deviation of the stick over the last 20 
milliseconds. This provides a metric (u) that is essentially independent of the system it is used with. It 
was found that a fi value of 0.025 and above yielded satisfactory results. If n dropped below this 
threshold, the parameters were frozen at their current values until n again rose above 0.025. 

5.5.2 Parameter Identification from a Simulation Model 

A sum-of-sine waves input was fed through a time- varying transfer function (short period approximation 
with an equivalent time delay) whose actual parameters are shown in Figure 68 by dashed lines. These 
parameters were estimated with the WERA method described above, and the correlation between the 
actual input and the pseudo-input (using the inverse of the estimated transfer function) is seen to be 
excellent except for the transient period following step changes. In Figure 69 the input driving the system 
is band-passed white noise, and identification in general is good. When the damping is increased at 45 
seconds, however, the damping estimate fails to track the change. 
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Figure 69. Time-Varying System Delay with Estimated Parameter Changes, Band-Passed White Noise Input 



5.5.3 Parameter Identification from Flight Test Data 

From October 1990 to March 1991 the U.S. Navy conducted a flying qualities evaluation of the F-14 with 
simulated dual hydraulic failure (Ref. 35). In this study, the back-up flight control module or BUFCM 
was evaluated to define areas of operation for in-flight refueling and landing. The BUFCM has two 
modes that are available to the pilot. The BUFCM-HIGH mode features a maximum stabilator rate of 10 
deg/s, while BUFCM-LOW has a 5 deg/s maximum rate. Although the aircraft demonstrated good 
handling qualities using the BUFCM in formation flight with a tanker, a number of PIOs were 
encountered during in-flight refueling, drogue tracking, and offset field landings. Because the F-14 was 
fully instrumented, a valuable PIO database was created. 

An analysis of this database was previously undertaken using Fast Fourier Transform techniques as 
reported in Ref. 36. Although the entire database is of interest. Run J_09 is of particular interest to this 
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project, because as shown in Figure 70 it features intermittent pilot-induced oscillations. That is, there is 
an initial PIO that occurs between 12 and 22 seconds, followed by a quiescent period up to 42 seconds or 
so, when a second PIO of smaller amplitude occurs. In the two PIO regions the rate limiting associated 
with the BUFCM-HIGH configuration is clearly visible in the triangle wave-like output evident in the 
stabilizer response. 

The pitch rate response to stick position were modeled with the short period approximation and an 
equivalent time delay: 

0(s) _ K (g + z) — 

S g {s) ( s 2 +2go) n s + G) n 2 ) 

Figure 71 shows the estimated equivalent time delay and time- varying airplane bandwidth parameters for 
the drogue tracking run. In general all three metrics are in consonance with the occurrence of PIO, 
although the changes are relatively small. That is, the aircraft system is always “bad” in terms of the 
airplane bandwidth criteria, but it is “worse” in the two PIO regions. The changes in the bandwidth 
parameters correlate well with the changes in pilot gain as seen by the amplitude changes in the Figure 70 
stick force response. Specifically, the lower stick amplitudes in the non PIO region reduced the severity 
of the rate limiting. The pilot then attempts to track the drogue again, the rate limiting becomes more 
severe, and the second PIO results. 
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6. LOCATS SIMULATION EVALUATION RESULTS 

6.1 Background 

6.1.1 LOCATS Evaluation Success Criteria 

There are two fundamental factors that will determine the ultimate success of the LOCATS concept. 
First, the LOCATS software must be able to detect impending loss of control events while minimizin g 
“false alarms” and/or missed events. Second, the time to detection must be minimiz ed, so that the pilot or 
automatic flight control system can react to the situation. Thus for a given flight control system failure 
scenario, the following questions will be addressed: 

• Can the wavelet-based computations run in a real-time environment? 

• Was loss of control or impending loss of control observed? 

• If yes, what was the triggering event? 

• If yes, was the event detected by the LOCATS software? 

• If no, was a non-event detected by the LOCATS.software? 

• What metric(s) provided the detection mechanism? 

• What was the detection time? 

• Can the detection time be improved? 

Later versions of the LOCATS software may include recommended courses of action that could be 
provided to the pilot in the form of a flight director or as direct commands to flight control system. 

6. 1 .2 Flight Conditions, Aircraft Configurations, and Pilot Evaluation Tasks 
6. 1.2.1 Flight Conditions 

The piloted evaluations will be conducted in both up-and-away and terminal flight conditions. The 
specific flight condition variations used in the LOCATS formal evaluation are identified in Table 6. Each 
evaluation began with the autopilot and autothrottle on and the aircraft trimmed. The steep approach 
flight conditions defined in the original test plan (see Volume II) were not used in the formal evaluations. 


Table 6. Flight Conditions for the Piloted Simulation 


No. 

ID 

Description 

Altitude 
(1000 ft) 

Airspeed 

(KCAS) 

Turbulence 

Cross winds 
(knots) 

i 

c 

Cruise 

20 

270 

None 

n/a 

2 

CM 

Cruise with Turbulence 

20 

270 

Moderate 

n/a 

3 

CH 

High Altitude Cruise 

40 

200 

None 

n/a 

4 

A 

Approach 

0.2 

130 

n/a 

None 

5 

AX 

Approach with Crosswind 

0.2 

130 

n/a 

20, R to L 


6. 1.2.2 Aircraft Configurations 


As mentioned above the piloted evaluations were conducted in both up-and-away and terminal flight 
conditions. The four aircraft configurations used in the LOCATS formal evaluation are identified in 
Table 7. These represent a subset of the ten configurations that were defined as part of the test plan (see 
Volume II). 
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Table 7. Aircraft Configurations for the Piloted Simulation 


No. 

ID 

Description 

Gross Weight 
(1000 lb) 

CG 

(%chord) 

Flaps 

(deg) 

Gear 

i 

CHF 

Cruise/Heavy/Forward CG 

580 

0.3 

Retracted 

Up 

2 

CLF 

Cruise/Light/Forward CG 

300 

0.27 

Retracted 

Up 

3 

CLA 

Cruise/Light/Aft CG 

300 

0.42 

Retracted 

Up 

4 

ALA 

Approach/Light/Aft CG 

300 

0.42 

27.4 

Down 


6. 1 .2.3 Pilot Evaluation Tasks 

The pilot evaluation tasks used in the LOCATS evaluation were as follows: 

• Pitch Attitude Capture and Hold (PACH): From steady level flight the pilot rapidly 
captured a pitch attitude of at least 5° above trim and maintain this attitude within the 
specified tolerances for 5 seconds or until stable. The target attitude was defined by a 
clearly displayed reference on the HUD pitch ladder. The pilot then performed 
subsequent 5° captures to complete the maneuver. Before proceeding to the next 
capture, the pilot maintain ed each attitude within the specified tolerances for 5 
seconds or until stable. 

• Bank Angle Capture and Hold (BACH): From steady, wings level flight the pilot 
rolled the aircraft and captured a bank angle of 30° and maintained this bank angle 
wi thin the specified tolerance for 5 seconds or until stable. Then the pilot made 
subsequent capture and holds of 0° and -30°. In some cases 20° bank angle captures 
were used to increase the aggressiveness of the task. 

• Pitch and Roll Sum-of-Sines Tracking (SOS): The pilot aggressively tracked error 
bars displayed on the HUD and attempted to keep the bars within the displayed 
tolerance reticles. The pitch and roll error bars were driven by signals representing 
the difference between the commanded attitude and the actual attitude. In this case 
the commanded attitude was driven by the sum of seven sine waves as defined in 
Volume II of this report. This task could be run in single or dual axis mode. 

• Pitch and Roll Discrete Tracking (DT): Pitch and Roll Sum-of-Sines Tracking (SOS): 

The pilot aggressively tracked error bars displayed on the HUD and attempted to 
keep the bars within the displayed tolerance reticles. The pitch and roll error bars 
were driven by signals representing the difference between the commanded attitude 
and the actual attitude. Here the commanded attitude was driven by a set of discrete 
steps and ramps as defined in Volume II of this report. This task is only effective in 
dual axis mode. 

Detailed maneuver descriptions and related background material are provided in Volume II of this report. 
6.1.3 Simulated Flight Control System Failures 

Flight control failures were introduced into the simulator at the discretion of the operator using the 
simulator change-a-gain feature. This feature allowed flight control system parameters to be varied from 
a default value to some new value, while the simulator was operating. The change-a-gain feature 
provided a choice of eight parameter values including the default value. Because of the interest in 
inducing loss of control, only the most severe changes from the default value were used. Table 8 provides 
a list of simulated flight control system failures based on the results of the simulation checkout as 
described in Volume II of this report. In addition, a new scenario was introduced involving the roll axis. 
As the formal evaluations progressed it became clear that loss of control in the roll axis (i.e., PIO or 
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otherwise) could not be induced with the available flight control system changes. To help “loosen” up the 
roll axis, a new change-a-gain option was made available that eliminated the sideslip rate feedback in the 
roll axis via the GBDEST gain. Eliminating this gain alone did not produce a noticeable change to the 
pilot. When used in conjunction with the elimination of the roll rate feedback, however, it was possible to 
generate at a minimum mild PIO in the roll axis. To coordinate its use in the evaluation process, this gain 
change was only used in conjunction with a PGain change. As mentioned in the previous section, 
multiple key strokes are required to make a single change. Wi thin the given time constraints, it was not 
possible to add the GBDEST to the saved signal list. Thus, the BGain change was always made first, 
followed by the PGain. Table 9 lists the change-a-gain values used in the LOCATS formal evaluation. 


Table 8. Simulated Flight Control System Failures 


No. 

ID 

Description 

Demonstration Maneuvers 

1 

PitchTC 

Alter pitch stick filter time constant via 
change-a-gain 

All pitch axis and dual axis tasks 

2 

PitchTD 

Inject pitch stick time delay 

DT, SOS, PACH 

3 

RollTD 

Inject roll stick time delay 

DT, SOS, BACH 

4 

QGain 

Alter pitch rate feedback via change-a-gain 

All pitch axis and dual axis tasks 

5 

PGain 

Alter roll rate feedback via change-a-gain 

All roll axis and dual axis tasks 

6 

BGain 

Alter GBDEST via change-a-gain (only used 
in conjunction with PGain) 

All roll axis and dual axis tasks 

7 

QLIM 

Reduce pitch rate command path limiter 

DT, SOS, PACH 

8 

PLIM 

Reduce roll rate command path limiter 

DT, SOS, BACH 


Table 9. Change-a-Gain Values for Simulated Flight Control System Failures 


No. 

ID 

Default Value 

Changed Value 

1 

PitchTC 

0 sec 

0.25 sec 

2 

PitchTD 

0 msec 

240 msec 

3 

RollTD 

0 msec 

240 msec 

4 

QGain 

0.4 

0 

5 

PGain 

1.0 

0 

6 

BGain 

1.2 

0.2 

7 

QLIM 

25 deg/sec 

7.5 deg/sec 

8 

PLIM 

120 deg/sec 

36 deg/sec 


6.2 Piloted Simulation 

6.2.1 Overview 

During the formal evaluation of the LOCATS system 122 analysis runs were completed. Of these 41 were 
diagnostic maneuvers that are used to characterize the configurations used in the formal evaluation or to 
examine the real-time properties of the wavelet-based computations. The diagnostic maneuvers included 
pitch and roll axis doublets and pitch and roll axis frequency sweeps. The maneuvers were conducted 
with autothrottle on and off. Throttle frequency sweeps were conducted with the autopilot on and off. 
The remaining 81 runs featured the flight control system failure scenarios defined in Table 8. Because of 
the limitations of the types of failures that could be introduced via the change-a-gain feature, the aircraft 
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could not be made to depart. It was possible, however, to repeatedly produce significant pilot-induced 
oscillations. A subset of these runs is discussed below as part of the LOCATS assessment. A complete 
run log is provided in Volume II of this report. 

As mentioned above a number of diagnostic maneuvers were conducted as part of the formal evaluation. 
The pitch and roll axis frequency sweep runs were used to obtain the airplane bandwidth parameters for 
the baseline configurations. The results are tabulated in Volume II of this report. In short, the pitch 
attitude tracking handling qualities of the baseline configurations fall solidly in the Level 2 region for 
bandwidth frequency. However, when the phase delay is taken into account, the configurations move into 
the Level 3 region. The roll attitude bandwidth frequencies of the baseline configurations fall into the 
Level 1 region, but the phase delay values, once again, move the configurations into the Level 3 region. 
The analyses documented in Volume II of this report reveal that a significant portion of the high phase 
delay values result from the dynamics of the pilot control stick. 

These results would seem to indicate that the aircraft model used in the LOCATS evaluation should be 
highly susceptible to PIO. It has been shown time and again, however, that it is difficult to induce PIO in 
a fixed base simulator with configurations and tasks that replicate flight test conditions (Refs. 5, 37 and 
38). As discussed in Ref. 5, higher gain tasks or other artificial means must be employed when using a 
fixed base simulator to induce PIO or to replicate PIO from flight. In the Ref. 38 simulator experiment, 
added time delays, increased stick gains, and added wind gusts and turbulence were used to better 
replicate flight test results. Although the results were not wholly satisfactory to the authors since the 
“good” handling configurations were affected by the changes just as the “bad” handling configurations 
were, PIO was more easily induced. It should be no surprise, therefore, to learn that the addition of 
significant added time delay was required to consistently generate PIO in the BAE SYSTEMS simulator. 
The addition of moderate turbulence was also useful in this regard. For the LOCATS assessment an 
added control stick time delay (pitch and/or roll) of 240 msec was used. This large added delay when used 
in conjunction with the Table 8 FCS failures regularly produced PIO. 

The following sections describe the simulator results for the four piloted evaluation tasks used in the 
formal LOCATS evaluation. To assess the TVTF and WERA analysis methods, a subset of the 81 
evaluation runs that represent a cross section of no PIO, mild PIO, and sustained or severe PIO cases were 
selected. To make best use of the available tools including the more recently incorporated transfer 
function estimation techniques (see Appendix B), the analyses were conducted with the STI wavelet 
toolbox. An assessment of the real time computation capabilities of the wavelet-based algorithms was 
made using LOCATS and is also reported on herein. 

6.2.2 Bank Angle Capture and Hold (BACH) Evaluations 
6.2.2. 1 Selected Evaluation Runs 

A log of the selected BACH evaluation runs is provided in Table 10. The table features the same format 
used for the complete run log that is provided in the Volume II report. The flight condition, aircraft 
configuration, and flight control system failure acronyms correspond to those defined previously in Table 
6, Table 7, and Table 8, respectively. As mentioned above, elimination of the roll rate feedback (PGain) 
alone was not enough to induce PIO. This is reflected in the R120 case that is included with the no PIO 
runs. Time histories and TVTF and WERA analysis results for all of the Table 10 runs are provided in 
Volume n. The more detailed analysis of an example no PIO, mild PIO, and sustained or severe PIO run 
is provided below. 
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Table 18. Selected BACH Evaluation Runs 


Run# 

FC 

Configuration 

Task 

FCS 

Comments 

No PIO Runs 

R77 

A 

ALA 

BACH 

n/a 


R80 

AX 

ALA 

BACH 

n/a 


R120 

CH 

CLA 

BACH 

PGain 

' 

Mild PIO Runs 

R28 

C 

CLA 

BACH 

BGain + 
PGain 

Mild, damped oscillations 

R79 

A 

ALA 

BACH 

BGain-t- 

PGain 

RolITD whole run, Large overshoots 

R122 

CH 

CLA 

BACH 

BGain + 
PGain 

RolITD whole run, mild PIO in 
middle or run 

Sustained or Severe PIO Runs 

R29 

C 

CLA 

BACH 

BGain + 
PGain + 
RolITD 

Large overshoots follow failure and 
lead to PIO, oscillations damp out 

R82 

AX 

ALA 

BACH 

BGain + 
PGain 

RolITD whole run, mild PIO 
transitions to severe, sustained 
oscillations 


6.2.2.2 Analysis of a No PIO Run (R77) 


Lateral stick position and roll attitude time histories for R77 are shown in Figure 72. The solid horizontal 
lines on the roll attitude plot indicate the target attitude for the captures. Not that although no PIO is 
evident in the run, several captures have at least one significant overshoot. This may be in part due to the 
dynamic characteristics of the control stick in roll that are documented in Volume II of this report. 
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Figure 72. R77 BACH, No PIO 
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Evaluation runs, such as R77, that did not involve a flight control system failure were used as control runs 
to compare the wavelet-based transfer function estimation methods with more traditional estimation 
techniques. Although not shown here comparisons were also made with results generated from the 
diagnostic maneuvers documented in Volume n of this report. A comparison of the TVTF and FFT roll 
attitude to lateral stick position transfer functions is provided in Figure 73. The TVTF plot is a snapshot 
in time (taken at 32.6 sec) with persistence lines that fade from dark to light over 10 seconds. There is 
good agreement between the two methods particularly in the important 0 dB magnitude crossover region 
and the -90 to -180 deg phase region. 



Figure 73. R77 PHI/DLAT Transfer Function Estimation 

Using the techniques described in Sections 4 and 5 time varying airplane bandwidth parameters were 
computed. The TVTF estimates were made using a 5 cycle Erlang mother wavelet with 21 point time 
averaging. (Note that the 5 cycle Erlang mother wavelet was used for all of the subsequent TVTF 
analyses described herein.) Smoother results were obtained with 41 point time averaging, but as one 
would expect, the increased time averaging increases the detection time. Analysis plots for all of the 
selected runs with both levels of time averaging are provided in Volume II of this report. For the roll axis 
cases, 2 nd order fits with an effective time delay were made to the TVTF roll rate to lateral stick frequency 
responses. The rate signal was used instead of attitude because as indicated in Figure 74a improved 
TVTF coherence was obtained with this signal. The fits were then used to compute time varying airplane 
bandwidth parameters. The R77 results are shown in Figure 74b and as expected are fairly uniform over 
the length of the run. 

For the roll axis cases the WERA method assumes a first order model with an equivalent time delay. The 
time varying model parameters for R77 are given in Figure 75a. Time varying bandwidth parameters are 
then computed from the frequency response generated from the identified model. The results which 
compare favorably with the TVTF are shown in Figure 75b. 
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a) Time Varying Model Parameters b) Time Varying Airplane Bandwidth 


Figure 75. R77 WERA Analysis 

6.2.23 Analysis of Mild PIO Run 

The lateral stick position, roll attitude time histories for the R122 BACH are shown in Figure 76. Also 
included in the figure is a time history of the roll rate feedback gain. Note that at approximately 48 
seconds, the feedback augmentation is removed. Following the FCS failure, increased overshoots and 
oscillations are seen in the roll attitude response, particularly around 80 seconds. After an initial large 
overshoot following the failure, the pilot copes well, and only mild PIO characteristics are observed. The 
primary effect is to degrade task performance. 
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Figure 76. R122 BACH, Mild PIO 

TVTF analysis results of this run are shown in Figure 77. In Figure 77a a roll rate to lateral stick position 
TVTF frequency response is shown for a time of 57.3 sec into the run. With the exception of the dip at 5 
rad/sec, the coherence is high in the frequency range associated with pilot control (i.e, the range in which 
the airplane bandwidth parameters are computed). The 2 nd order plus equivalent time delay fit to the 
TVTF is represented by the thin line. The corresponding airplane bandwidth parameters that were 
computed from the fit are provided in Figure 77b. The primary effect of the roll rate FCS failure is to 
reduce the system bandwidth. As indicated in Table 10 this run featured the added 240 msec of roll stick 
time delay for the entire run. This added time delay produces the high phase delay values that remain 
essentially constant, even after the FCS failure. This result is not unexpected as significant phase delay 
changes are not expected with failures that reduce the amount of augmentation in the system (i.e., changes 
that make the system more like a bare airframe). In the end the system is by around SO seconds 
characterized by a low phase bandwidth with a corresponding large phase delay that results in the mild 
PIO observed in the time responses. 

The corresponding WERA results for this run are shown in Figure 78. Figure 78a displays the time 
varying model parameters used to generate the frequency response from which the bandwidth parameters 
are computed. In this example, the equivalent time delay remains fairly constant, while the gain and 
break frequency wander. The bandwidth results seen in Figure 78b are in good agreement with the TVTF 
results. Here though the detection of the FCS failure is more rapid. 
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a) Time Varying Model Parameters b) Time Varying Airplane Bandwidth 


Figure 78. R122 WERA Analysis 
6.2.2.4 Analysis of Sustained or Severe PIO Run 

Time histories for the R29 severe PIO example are shown in Figure 79. This run was characterized by 
two FCS failures. First, the roll rate augmentation is removed just after 40 seconds. This produces some 
increased overshoots, but no sustained oscillations. At just after 80 seconds, the roll stick time delay is 
added. This results in multiple overshoots of nearly double the target attitude. Thus, even though the 
oscillations are not sustained, the magnitude of the oscillations is severe, and prohibits the pilot from 
satisfactorily completing the capture and hold task. 
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Figure 79. R29 BACH, Sustained or Severe PIO 

A snapshot of the TVTF frequency response with the corresponding fit at a time of 95 sec is displayed in 
Figure 80a. The corresponding bandwidth parameters are shown in Figure 80b. Although there is a 
reduction in bandwidth associated with the roll rate feedback failure, it is the added stick delay that 
degrades the system to the extent that a severe PIO results. The effect of the added stick delay is to 
reduce the gain bandwidth (although the phase bandwidth remains the lower of the two) and to 
significantly increase the phase delay. The rapid rise in phase delay corresponds with the large roll 
attitude overshoot seen at 85 sec. 

The WERA analysis results are presented in Figure 81 and once again excellent agreement is seen with 
the TVTF results. In contrast to the R122 results, in this case the gain and break frequency parameters 
remain fairly constant, while the significant model variation is seen in the equivalent time delay. Of 
course, this is the expected result when the system change is associated with the insertion of a large pure 
time delay. In this example, the detection times are again similar, although the TVTF captures the effect 
of the added delay more rapidly. 
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a) P/DLAT Fit to TVTF at 95 sec 


b) Time Varying Airplane Bandwidth 


Figure 80. R29 TVTF Analysis (21 Point Time Averaging) 
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Figure 81. R29 WERA Analysis 

6.2.3 Pitch Attitude Capture and Hold (PACH) Evaluations 
6.2.3. 1 Selected Evaluation Runs 

A log of the selected PACH evaluation runs is provided in Table 11. The table features the same format 
used for the complete run log that is provided in the Volume II report. The flight condition, aircraft 
configuration, and flight control system failure acronyms correspond to those defined previously in Table 
6, Table 7, and Table 8, respectively. For the PACH runs both the pitch rate feedback failure and a 
reduction in the pitch rate command rate limit produced PIO, especially when the added pitch stick time 
delay was present from the start of the run. 


TR 1341-1 


85 

















Table 11. Selected PACH Evaluation Runs 



Run# 

FC 

Configuration 

Task 

FCS 

Comments 

No PIO Runs 

R68 

CM 

CLA 

PACH 

n/a 

No change 

Mild PIO Runs 

R95 

CM 

CLA 

PACH 

QLIM 

Oscillations after failure 

R96 

CM 

CLA 

PACH 

QLIM 

PitchTD whole run, some PIO 

R115 

CH 

CLA 

PACH 

QGain 

Three cycle PIO following failure 

R117 

CH 

CLA 

PACH 

QLIM 

PitchTD whole run, small amplitude 
but sustained PIO 

Sustained or Severe PIO Runs 



CLA 

PACH 

QGain 

PitchTD from start, autothrottle 
disengage triggers sustained PIO 

R69 

CM 

CLA 

PACH 

QGain 

PitchTD whole run, PIO 

R94 

CM 

CLA 

PACH 

QGain 

PitchTD whole run, significant PIO 
after failure 

R116 

CH 

CLA 

PACH 

QGain 

PitchTD whole run, PIO 


6.2.3.2 Analysis of No PIO Run 

Longitudinal stick position and pitch attitude time histories from the R68 no PIO case are shown in Figure 
82. Here again the solid lines on the pitch attitude plot refer to the target attitude for the capture and hold 
task. With the baseline aircraft, the pilot easily performed the task within the desired performance 
requirements (see complete task description in Volume II of this report). 
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Figure 82. R68 PACH, No PIO 
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Since there are no changes introduced, comparisons between the TVTF estimation and the traditional FFT 
can be made. The results that are shown in Figure 83 indicate good agreement between the two methods. 
One change of note from the roll axis results discussed previously (see Figure 73) is the improved 
coherence observed in this example. Specifically, the high coherence frequency region extends beyond 
that seen in the roll axis. A TVTF snapshot at 55.1 sec with a corresponding 3™ order including an 
equivalent time delay is displayed in Figure 84a. The fits to the complete TVTF are then used to compute 
the time varying airplane bandwidth parameters shown in Figure 84b. The corresponding WERA results 
are provided in Figure 85. There is good agreement between the two methods for the phase bandwidth 
and phase delay parameters. For this example, however, the gain bandwidth computed from the WERA 
frequency response tends to oscillate over the length of the run. 



Figure 83. R68 THE/DLON Transfer Function Estimation 



a) Q/DLON Fit to TVTF at 55. 1 sec b) Time Varying Airplane Bandwidth 


Figure 84. R68 TVTF Analysis (21 Point Time Averaging) 
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a) Time Varying Model Parameters b) Time Varying Airplane Bandwidth 

Figure 85. R68 WERA Analysis 


6.2.3.3 Analysis of Mild PIO Run 

Pitch axis time histories for the R115 mild PIO run are shown in Figure 86. For this run the pitch rate 
feedback was removed just before the 45 sec point. The failure produced a mild PIO on the next capture 
that was characterized by a 3 cycle damped oscillation. Smaller magnitude oscillations are seen on the 
subsequent capture. 



Results of the TVTF analysis for this run are shown in Figure 87. The TVTF snapshot of Figure 87a 
displays good coherence for the primary frequency range of interest and an excellent fit. The 
corresponding time varying bandwidth parameters are given in Figure 87b. As was observed with the roll 
rate feedback failure, the primary effect of the change in pitch rate feedback is to reduce the bandwidth. 
Elimination of the augmentation produces no significant change in phase delay, a result verified by the 
analysis of the frequency sweep runs (see Volume II) with and without the pitch rate feedback. There is a 
slight increase in the gain bandwidth that coincides with a slight dip in the phase delay following the 
failure. It is the reduction in phase bandwidth, however, that provides the indicator of the degraded 
characteristics of the aircraft configuration. 


Results from the R1 15 WERA analysis are displayed in Figure 88. For this example the equivalent time 
delay (see Figure 88a) continues to increase following the failure, while the other model parameters 
remain more or less constant. This produces the steadily increasing phase delay of Figure 88b. The gain 
bandwidth parameter also appears to be too low, even prior to the failure. The apparent inconsistency of 
these results, at least following the failure, should be expected given that the correlation parameter (see 
Figure 88b) falls well below the desired value of 1 beyond 46 sec. 
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Figure 87. R115 TVTF Analysis (21 Point Time Averaging) 
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a) Time Varying Model Parameters 


b) Time Varying Airplane Bandwidth 


Figure 88. R115 WERA Analysis 
6.2.3.4 Analysis of Sustained or Severe PIO Run 

Time histories for the R69 sustained or severe PIO run are found in Figure 89. This run featured the 
added stick time delay for the entire run length and a failed pitch rate feedback at just under 24 seconds. 
Following the failure there are sustained oscillations that dominate each of the subsequent capture 
attempts. Although the oscillations are damped they do prevent the pilot from completing the task. 

In Figure 90 the TVTF analysis results of this severe PIO case are given. Once again the third order plus 
equivalent time delay fit provides an excellent match to the TVTF frequency response following the 
failure at the 27.2 sec mark in the run (see Figure 90a). Just as with the mild PIO run, the primary effect 
of the failure is to significantly reduce the phase bandwidth as shown in Figure 90b. On the other hand, 
the gain bandwidth remains essentially unchanged, while there is a slight reduction in the corresponding 
phase delay. 

WERA results for this run are given in Figure 91. As was the case with the other two pitch cases 
discussed thus far, the gain bandwidth parameter appears to be too low in value throughout the run. The 
phase bandwidth, on the other hand, agrees well with the TVTF results as does the phase delay parameter 
with the exception of the region following the failure where the correlation measure dips. 
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Figure 89. R69 PACH, Sustained or Severe PIO 



a) Q/DLON Fit to TVTF at 27.2 sec 


b) Time Varying Airplane Bandwidth 


Figure 90. R69 TVTF Analysis (21 Point Time Averaging) 
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Figure 91. R69 WERA Analysis 

6.2.4 Sum-of-Sines Tracking (SOS) Evaluations 
6.2.4. 1 Selected Evaluation Runs 

A log of the selected SOS evaluation runs is provided in Table 12. The table features the same format 
used for the complete run log that is provided in the Volume II report. The flight condition, aircraft 
configuration, and flight control system failure acronyms correspond to those defined previously in Table 
6, Table 7, and Table 8, respectively. Selected runs feature two no PIO cases, one pitch axis and one roll 
axis. Two corresponding sustained or severe PIO cases are also included. Note that the added stick time 
delays were included over the entire run lengths for the PIO cases. 

Table 12. Selected SOS Evaluation Runs 



Run# 

FC 

Configuration 

Task 

FCS 

Comments 

No PIO Runs 

R118 

CH 

CLA 

SOS 

n/a 

Pitch axis only 

R123 

CH 

CLA 

SOS 

n/a 

Roll axis only 

Sustained or Severe PIO Runs 

R119 

CH 

CLA 

SOS 

QGain 

Pitch axis only, PitchTD whole run, 
sustained PIO follows failure 

R124 

CH 

CLA 

SOS 

BGain-t- 

PGain 

Roll axis only, RollTD whole run, 
sustained oscillations 



6.2.4.2 Analysis of Pitch Axis No PIO Run 

Longitudinal stick position and pitch attitude time histories for the R118 no PIO case are given in Figure 
92. No significant observations are made, here other than to say the pilot was able to perform the task well 
with the baseline aircraft. 
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Figure 92. R118 Pitch Axis SOS, No PIO 

FFT and TVTF comparisons for R118 are provided below in Figure 93. Here again the two techniques 
compare favorably in the frequency range of interest. Note that both frequency responses display the dip 
in coherence in the neighborhood of 0.4 rad/sec. Both responses also indicate a -180 deg crossing at 
approximately 5 rad/sec and a 0 dB crossing around 1.2 rad/sec. 



Figure 93. R118 THE/DLON Transfer Function Estimation 
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TVTF results for this run are shown in Figure 94. Although the fit to the TVTF frequency response is 
good (see Figure 94a), this run appears to suffer somewhat from the drop in coherence above 6 rad/sec. 
This is most evident in the gain bandwidth and phase delay parameters, both of which are tied to the -180 
deg frequency point, that oscillate somewhat about a nominal value. The phase bandwidth parameter that 
is obtained in the high coherence region, on the other hand, has a much more uniform value. 

The phase bandwidth results from the WERA analysis are also quite smooth (see Figure 95) and agree 
well with the TVTF results. The issues previously noted with the gain bandwidth and phase delay 
parameters are again noted here. 
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a) Time Varying Model Parameters 
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Figure 95. R118 WERA Analysis 
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u.2.4.3 Analysis of Sustained or Severe Pitch Axis PIO Run 

Time histories for the sustained or severe PIO example are shown in Figure 96. Note that when the pitch 
rate feedback fails at just under 48 sec, the pilot enters a sustained PIO and all but abandons the task for 
the next 70 sec. 



Figure 96. R119 Pitch Axis SOS, Sustained or Severe PIO 

The TVTF analysis plots for this run are given in Figure 97. The bandwidth parameters (see Figure 97b) 
show a region of scatter in the neighborhood of 55 sec. Note that the fit to the TVTF frequency response 
suffers in this region as seen in Figure 97a. Despite this issue, the parameters overall respond to the 
trends established in the previous pitch axis PIO examples. 

For this example the WERA analysis as shown in Figure 98 follows previously established trends 
although there is better agreement with the TVTF results. The phase delay parameter also begins a slow 
and steady rise when the correlation drops below 1 after the 50 sec marie. 
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a) Time Varying Model Parameters b) Time Varying Airplane Bandwidth 

Figure 98. R119 WERA Analysis 
6.2.4.4 Analysis of Roll Axis No PIO Run 

Lateral stick position and roll attitude time histories for the R123 no PIO case are given in Figure 99. No 
significant observations are made here other than to say the pilot was able to perform the task reasonably 
well with the baseline aircraft. FFT and TVTF comparisons are found in Figure 100. There is good 
agreement between the two methods including a s imilar drop in coherence between 1 and 2 rad/sec. 
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a) FFT b) TVTF at 45.6 sec 

Figure 100. R118 THE/DLON Transfer Function Estimation 

Following the first 30 sec of the run the TVTF provides fairly smooth results as shown in Figure 101. 
Equivalent results were obtained using the WERA technique (see Figure 102). 
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a) P/DLAT Fit to TVTF at 45.6 sec b) Time Varying Airplane Bandwidth 


Figure 101. R123 TVTF Analysis (21 Point Time Averaging) 
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Figure 102. R123 WERA Analysis 
6.2.4.5 Analysis of Roll Axis Sustained or Severe PIO Run 

Time histories for the sustained or severe PIO example are shown in Figure 103. Note that when the roll 
rate feedback fails at just over 41 sec, the pilot enters a sustained PIO and all but abandons the task for the 
next 70 sec. Both the TVTF (Figure 104) and WERA (Figure 105) results provide similar results, where 
the primary effect of the FCS failure is to reduce the phase bandwidth. 
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Figure 103. R124 Roll Axis SOS, Sustained or Severe PIO 
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Figure 105. R124 WERA Analysis 


6.2.5 Discrete Tracking (DT) Evaluations 
6.2.5. 1 Selected Evaluation Runs 

A log of the selected pitch and roll DT evaluation runs is provided in Table 13. The table features the 
samp, format used for the complete run log that is provided in the Volume II report. The flight condition, 
aircraft configuration, and flight control system failure acronyms correspond to those defined previously 
in Table 6, Table 7, and Table 8, respectively. 


Table 13. Selected DT Evaluation Runs 



Run# 

FC 

Configuration 

Task 

LOC 

No PIO Runs 

R15 

C 

CHF 

DT 

n/a 

R18 

C 

CHF 

DT 

PLIM 


Comments 


Mild PIO Runs 


R70 

CM 

CLA 

DT 

QGain + 
BGain + 
PGain 

Mild pitch PIO 

■ 

CM 

CLA 

DT 

QGain + 
BGain + 
PGain 

PitchTD and RollTD whole run, 
pitch PIO 

R99 

CM 

CLA 

DT 

QGain 

Mild pitch PIO 

R100 

CM 

CLA 

DT 

QGain 

PitchTD whole run, large overshoot 
following failure, mild PIO 

Run# 

FC 

Configuration 

Task 

LOC 

Comments 
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iU uv 

CM 

rr a 

DT 

QGain + 
BGain + 
PGain 

PitchTD and RollTD whole run, 
multi-axis failures 

Sustained or Severe PIO Runs 

R128 

CH 

CLA 

DT 

BGain + 
PGain 

PitchTD and RollTD whole run, 
sustained roll PIO 


6 . 2.52 Analysis of No PIO Run 

Pitch and roll axis time histories for the no PIO run, R15, are provided in Figure 106. Note that the DT 
task features bank angle captures of nearly 60 deg. 




Figure 106. R15 DT, No PIO 
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a) Q/DLON Fit to TVTF at 61.2 sec 


b) Time Varying Airplane Bandwidth 


Figure 108. R15 Pitch Axis TVTF Analysis 
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a) Time Varying Model Parameters b) Time Varying Airplane Bandwidth 


Figure 109. R15 Pitch Axis WERA Analysis 

The roll axis results, although not as clean as seen previously, are much improved in comparison to the 
pitch axis. This is seen first in the good agreement between the FFT and TVTF methods as shown in 
Figure 110. Next, there is also good agreement between the TVTF (Figure 111) and WERA (Figure 112) 
analyses. Note also the improved coherence Figure 111a that is achieved using the roll rate signal as 
compared to the roll attitude signal as seen in Figure 1 10b. 



Figure 110. R15 PHI/D LAT Transfer Function Estimation 
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a) Time Varying Model Parameters b) Time Varying Airplane Bandwidth 


Figure 112. R15 Roll Axis WERA Analysis 


6.2.5.3 Analysis of Mild Pitch Axis PIO Run 

Time histories for the mild pitch axis PIO of R99 are shown in Figure 113. In this example the pitch rate 
feedback fails at just over 44 sec, and mild pitch oscillations result. Better results for the TVTF (Figure 
114) and WERA (Figure 115) analyses were obtained with this run. As demonstrated previously, the 
primary effect of the FCS failure is to decrease the phase bandwidth. Both methods demonstrate this 
result effectively. The TVTF technique displays a sensitivity in gain bandwidth that seems related to 
issues with the estimated frequency response below 0.75 rad/sec that were unique to this task. The 
WERA results, on the other hand, again show the previously discussed pitch axis issues with gain 
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a) Q/DLON Fit to TVTF at 54.8 sec b) Time Varying Airplane Bandwidth 


Figure 114. R99 TVTF Analysis (21 Point Time Averaging) 



a) Time Varying Model Parameters b) Time Varying Airplane Bandwidth 



Figure 115. R99 WERA Analysis 


6.2.6 Analysis of Sustained or Severe Roll Axis PIO Run 

Time histories for a sustained or severe roll axis PIO case are shown in Figure 1 16. As shown in the 
figure, following the roll rate feedback failure at just past 70 sec, significant roll overshoots develop that 
lead to sustained oscillations after the tracking task ends at roughly 140 sec. As was demonstrated with 
the no PIO DT run, the roll axis TVTF (Figure 1 17) and WERA (Figure 118) analyses yield much cleaner 
results than those shown for the pitch axis. There is also good agreement between the two methods. 
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Figure 116. R128 DT, Sustained or Severe Roll PIO 
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a) Time Varying Model Parameters b) Time Varying Airplane Bandwidth 

Figure 118. R128 WERA Analysis 


6.3 Assessment of LOCATS Real-Time Computation Capabilities 
6.3.1 Timing Loop 

The real time signals used by LOCATS are obtained from the Mil 1553 data bus via software data 
requests. These requests are inside a timing loop as follows: 

Top of timing loop 

Start 20 msec timer and record current time 
Request signals 
Store signals 
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Transform calculations (if any) 

Plotting (if any) 

Loop to use up remaining part of 20 msec (if any) 

End of timing loop 

The calculations depend on the choice of plots. Stripcharts are updated each cycle. The time series for 
PSD and TF plots are stored every cycle, but the transform calculations and plotting are updated every 
Nincr samples, where Nincr is a specified number of increments. For example, if one transform has Nincr 
= 5 and a second has Nincr = 7, then they are computed and plotted respectively every 5 and 7 samples, 
overlapping every 35 samples. 

Another factor in the timing is the number of lines drawn on each plot. The PSD and TF plots can have 
multiple lines, as determined by the “persistence” parameters. Drawing multiple lines turned out to have a 
larger timing penalty then computing transforms. 

If the calculations and plotting take longer than 20 msecs then the final part of the timin g loop is 
bypassed, and the next cycle starts by resetting the timer to zero and requesting the next batch of signals. 
The time at the start of each cycle is stored and the delta time indicates whether or not a slip occurs. There 
is not a master clock with 20 msec increments. The 20 msec timer starts when the previous cycle is 
completed. 

6.3.2 Timing and Quantization of Buffered Signals 

The signals on the Mil 1553 bus are updated according to the simulator software and are not under the 
control of LOCATS. The simulator consists of several computers including the flight control system 
computers, and their update cycles are not synchronized with LOCATS. The update rate turned out to be 
different depending on the signal, and for a given signal the update rate was not always uniform. The Mil 
1553 bus holds the previous value of each signal until it is updated. 

A detail of signals from LOCATS Run 41 is shown in Figure 119 and Figure 120. Each dot is a recorded 
value for that signal. The signal timing and quantization can be determined from these plots. Comments: 

• The first line is the delta time between successive signals, and in this 2.5 second 
segment of data the delta time holds steady at 20 msec indicating there is no slippage. 

• Each sample of the Q signal is held for 2 cycles, indicating the update rate is about 
half of the 50 Hz rate set for LOCATS. 

• Each sample of the VCAS signal is held for at least 4 cycles, indicating an update 
rate about one-forth of 50 Hz. Sometime the signal is held for more than 4 cycles, 
due to quantization. 

• Most samples of the THE signal are held for 1 cycle, and occasionally 2 cycles, 
indicating an update rate of about 50 Hz but not quite synchronized with the 
LOCATS update. 

• The DLON samples are all held for one cycle, perfect synchronization over this 
segment of data. 

• The lateral axis signals (PHI, P, and DLAT) are all held for many cycles, due mainly 
to quantization. The pilot input is primarily pitch for this run. 

6.3.3 Timing Tests 

LOCATS requests data from the Mil 1553 bus every 20 msec, but slips when the calculations and/or 
plotting takes more than this amount. The time of each sample is recorded from a precision timer built 
into the PC, and the delta time can therefore be used to test the computation time. 
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Several LOCATS runs were used primarily to record calculation times. The type of input is not relevant 
to the timing, but for the record each of these timing test runs was a single pitch doublet with data 
collected for 20 to 30 seconds. The number of plots and the length of the transform calculations were 
varied for each run. The transform calculations were either FFTs or wavelets, computed every Nincr 
samples, one time for each plot. The “persistence” is the number of lines drawn for each PSD plot, a 
persistence of 10, for example, plots the current PSD line and the 9 previously calculated PSD lines. 

The results of the timing tests are summarized in Table 14. The delta time plots for most of the runs are 
included in Figure 121 and Figure 122 (the runs not included have flat, 20 msec delta time plots). 

Conclusions: 

• No slippage with just stripcharis. 

• No slippage for a single PSD plot using either FFTs or wavelets up to length 4096. 

The number 4096 can be increased some, but the tests are not sufficient to determine 
an exact bound. 

• Plotting with persistence results in severe timing slippage, taking as much as 10 times 
longer than the transform calculations. 

Recommendations: 

• Use the current version of LOCATS with just stripcharis. This is the safest way to 
obtain data with no slippage (this is what was done for runs above R8). 

• Change the LOCATS software to separate the data collection from the calculations 
and plotting. Do this either with a single computer using interrupt driven multiple 
threads, or with separate computers. Writing this type of software was beyond the 
scope of the current project. 
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Figure 120. (Part 2 of 2) Detail of Signals Showing Timing and Quantization 
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Table 14: LOCATS Timing Tests 


LOCATS 

Run# 

Description 
Of Run 

Real Time Plots 

# Samples out of first 
1000 that slip more than 
0,1 msec (nominal value is 
20 msec) 

39 

Pitch doublet 

Stripchart only 

0 


Pitch doublet 

Stripchart 

4096 point FFT (Persistence =1) 

0 i 

42 

Pitch doublet 

Stripchart 

4096 point FFT (Nincr = 6, Persistence =1) 
4096 point Wavelet (Nincr = 8, Persistence^)) 

158 

(slips to about 30 msec 
every 24 samples when 
transforms line up) 

43 

Pitch doublet 

Stripchart 

4096 point FFT (Nincr = 6, Persistence = 10) 
4096 point wavelet (Nincr = 8, Persistence = 10) 

196 

(slips to 40 to 60 msec for 
each transform plot, slips to 
140 to 160 msec every 24 
samples when transform 
plots line up) 

60 

Pitch doublet 

Stripchart 

8192 point wavelet (Nincr = 6, Persistence = 1) 

136 

(slips 0 to 4 msec for each 
transform) 

61 

Pitch doublet 

Stripchart 

4096 point wavelet (Nincr = 6, Persistence =1) 

0 

62 

Pitch doublet 

Stripchart 

6144 point wavelet (Nincr = 6, Persistence =1) 

3 

(slips more than 0.1 msec 3 
times, with a max slip of 
0.6 msec) 

63 

Pitch doublet 

Stripchart 

8196 point FFT (Nincr = 6, Persistence = 1) 
6144 point wavelet (Nincr = 7, Persistence =1) 

35 

(slips 6 to 10 msec every 
42 samples when transform 
line up) 
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msec 


Locats: Run#41 (PD strip+FFT): 
data time (msec) 






Figure 121. (Part 1 of 2) LOCATS Timing Tests 
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Locats: Run#43 (PD st+FFT+wava+pars): 



Locats: Rur*60 (PD atrip+vwyc/81 92); 
/ '.data time (msec) 

- — r- — - — — ■ — - ~ 



Locats: Run#62 (PD strip+wave/61 44): 
detta time (msec) 

n — r “ . : 



10 15 20 25 


Locats. Run#63 (PD str+w«5144+f8192): 
delta time (msec) 



.22. (Part 2 of 2) LOCATS Timing Tests 
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6.4 Assessment of LOCATS Failure Detection 

Changes are made midway through a run to the Stability Control and Augmentation System (SCAS) in 
the manned simulator. Most of the changes are to zero out selected gains, effectively disconnecting the 
SCAS so that the pilot suddenly has to control the open loop vehicle. Other changes are to suddenly add 
significantly more delay. The SCAS changes are considered failures, the estimated stability metrics 
change as a result of these failures, and the question is how long does it take to detect the change in the 
stability metrics? 

The detection is not automated in real time, and the detection times listed in Table 15 are computed by 
post-processing of the data. The stability metric that changes the most is selected, initial and final values 
on either side of the failure are measured, and the detection time is defined as the time it takes for the 
metric to cross percentage thresholds between the initial and final values. The process for measuring 
detection time is illustrated for Run 122 in Figure 123. In this example it takes 11.1 seconds for the phase 
bandwidth to cross the 60% threshold line. 

Each of the failures in Table 15 results in PIO. The period of the dominant frequency in the oscillation is 
reported in Table 15. Scalograms (i.e., wavelet transforms) of the output response are used to identify the 
dominant frequency. An example for Run 122 is shown in Figure 124. The concentration of power at the 
PIO frequency is nicely displayed in this plot. 

Upon reviewing Table 15 the following comments are made: 

• The 60% threshold is a reasonable value to use for detection, the tradeoff being false alarms and 
detection time. 

• The detection time in the pitch axis (for the 60% threshold) is consistently around 6.5 seconds. 

• The detection time in the roll axis (for the 60% threshold) has a larger range of values, from 5.1 
to 11.5 seconds. 

• The detection time as a ratio of the PIO frequency is a good figure of merit. These ratios are 
included in Table 15. Detection in less than 2 cycles is considered good. 

• The detection time in the pitch axis (for the 60% threshold) ranges from 1.3 to 1.9 cycles. 

• The detection time in the roll axis (for the 60% threshold) ranges from 0.9 to 2.1 cycles. 
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Table 15. Failure Detection Times 


Run 

FC 

Config 

R122 

CH 

CLA 


R115 CH 
CLA 



R119 CH 
CLA 


R128 CH 
CLA 


SCAS 

change 


BACH BGain 
and 
PGain 
zeroed 


PIO Stability 
Comment period metric 
[sec] change 


PACH 


RollTD 
whole run, 
mild PIO 


BACH RollTD Large 

increased overshoots 
and PIO 


PACH QGain Three 

zeroed cycle PIO 


QGain 

zeroed 


SOS QGain 
(Pitch) zeroed 


R124 

CH 

CLA 

SOS 

(Roll) 

R99 

CM 

CLA 

DT 

(Pitch) 



DT BGain 
(Roll) and 

PGain 

zeroed 



Pitch TD 
whole run, 
PIO 


Pitch TD 
whole run, 
sustained 
PIO 


RollTD 
whole run, 
sustained 
oscillations 


QGain Mild PIO 








Pitch TD 
and roll TD 
whole run, 
sustained 
roll PIO 



Detection time for 
stability metric change 
[sec] 

(ratio with PIO period) 


CO . 

phase 

0.96 — » 
0.48 r/s 


0.11 

0.30 sec 


® phase 

3.3 — » 

1.4 r/s 


® phase 
2.1 — » 
1.1 r/s 


® phase 
2.1 

1.1 r/s 


^ phase 
1 . 1 -» 
0.48 r/s 


® phase 

4.2 — » 
1.4 r/s 


, phase 
1.1 

0.58 r/s 




6.9 

11.2 

(1.6) 

(2.5) 



Abbreviations: C = cruise, CM = cruise with turbulence, CH = high altitude cruise, CLA = cruise light aft 
eg, BACH = bank angle capture and hold, PACH = pitch angle capture and hold, SOS = sum of sines, DT 
= discrete tracking, PIO = pilot induced oscillation, TD = time delay 
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7. SUMMARY AND CONCLUSIONS 


7.1 Program Summary 

Wavelet transforms are used for on-line detection of aircraft loss of control. Wavelet transforms are 
compared with Fourier transform methods and shown to more rapidly detect changes in the vehicle 
dynamics. This faster response is due to a time window that decreases in length as the frequency 
increases. New wavelets are defined that further decrease the detection time by skewing the shape of the 
envelope. 

The wavelets are used for power spectrum and transfer function estimation. Smoothing is used to tradeoff 
the variance of the estimate with detection time. Wavelets are also used as front-end to the eigensystem 
reconstruction algorithm. Stability metrics are estimated from the frequency response and models, and it 
is these metrics that are used for loss of control detection. 

A Matlab toolbox was developed for post-processing simulation and flight data using the wavelet analysis 
methods. A subset of these methods was implemented in real time and named the Loss of Control 
Analysis Tool Set or LOCATS. A manual control experiment was conducted using a hardware-in-the- 
loop simulator for a large transport aircraft, in which the real time performance of LOCATS was 
demonstrated. The next step is to use these wavelet analysis tools for flight test support. 

7.2 Strengths and Weaknesses of the Wavelet-based Analysis Methods 

7.2.1 TVTF 

Real time computation of the Time Varying Transfer Functions using wavelet transforms was 
demonstrated using the LOCATS software. The wavelet transforms were computed using convolution 
summations with stored and sampled mother wavelets. 

The main advantage of the wavelet based method versus Fourier methods is the faster detection of 
changes in the frequency response. This was expected based on the theory and the Phase I feasibility 
study, and the faster detection was verified in reeil time using LOCATS. 

Another advantage of wavelet methods is they are non-parametric, meaning a model of the system is not 
needed in order to estimate the frequency response. 

A weakness of wavelet methods is the input must be consistently exciting in the frequency ranges of 
interest. This is true of sum-of-sine inputs and Guassian inputs, but not true of chirps and discrete inputs. 

The variance of the estimated frequency response is significantly reduced by smoothing in time and 
frequency, but this remains an issue that needs improvement. 

The detection of frequency response changes and stability metric changes was not automated. The faster 
detection of wavelets versus Fourier methods is based on post-processing the data and also by qualitative 
assessments made by viewing the data. 

7.2.2 WERA 

Wavelets can be used as a front end for the Eigensystem Realization Algorithm. The Markov parameters 
are estimated in the transform domain and then converted back to the time domain. This methodology 
was demonstrated on simulated data and by post-processing the experimental data, but was not 
implemented in real time. 

The main advantage of WERA is the reduced sensitivity to measurement noise. This advantage was 
demonstrated using the experimental data. 
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The WERA method was further modified to reduce sensitivity to the initial conditions, and this was also 
demonstrated. The current development, however, is sensitive to modeling assumptions and limited to 
second order models. 

The WERA is also sensitive to offsets in the data, as is typical of aircraft data. Currently this remains an 
open problem. 

7.3 Assessment of the LOCATS Software 

7.3.1 Real Time Performance 

The longest wavelet transform demonstrated in real time had 4096 points for the lowest frequency (the 
number of points decreases as the frequency increases). The longest Fourier transform demonstrated in 
real time also had 4096 points. Multiple transforms and longer transforms result in slippage in the data 
collection with resulting non-uniform samples. 

The transform plots have a “persistence” parameter that allows multiple lines on each plot, so that current 
and previous transforms can be compared. The plotting package was slow in doing this, however, and the 
use of persistence caused slippage in the data collection, more serious than the use of transforms of 16K 
points. 

With the current implementation of LOCATS it is recommended that data be collected using just strip 
charts and a single power spectra calculation with less than 4096 points and with no persistence. 

The main limitation in performance is that all of the transform calculations and plotting needs to take 
place within a single sample period, set at 50 msec for the experimental data collection. 

A multi-processor or multi-thread implementation is needed to improve the performance, so that 
transform calculations and plotting can extend beyond a single sample period with slippage in the data 
collection. For example, if the transforms are computed every 10 samples then 500 msec would be 
available for calculation and plotting. 

The convolutions used to compute the continuous wavelet transforms are estimated to take about 30N 
multiplications, where N is the number of points, considerably less than N-squared for large N, but not as 
fast as the pyramid algorithm for digital wavelets. Digital wavelets require multiple voices to meet 
frequency resolutions requirements for systems analysis, nevertheless there are improvements to be made 
in the real time calculation. 

7.3.2 LOCATS Success Criteria 

Was loss of control or impending loss of control observed? 

• Yes, numerous PIO events were encountered. They were not divergent. 

If yes, what was the triggering event? 

• The triggering event was primarily a FCS rate feedback gain change in the presence 
of a significant added time delay. 

• Inadvertent autothrottle disengage at a FCS failure point triggered a PIO. 

• Changes in command path rate limits triggered mild PIO. 

If yes, was the event detected by the LOCATS software? 

• Changes in frequency response and airplane bandwidth were measured in real-time. 

• Automated real-time detection mechanisms were not implemented. 

If no, was a non-event detected by the LOCATS software? 
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• Time and frequency domain smoothing reduces variance and provides 
measures. 

• Smoothing reduces probability of false alarms. 

What metric(s) provided the detection mechanism? 

• Airplane bandwidth was the primary metric. 

What was the detection time? 


coherence 


• Definition of detection time is sensitive to type of FCS failure. 

• For feedback gain changes and insertion of added time delay, detection time can be 
measured from time of failure. 

• For rate limiting, detection time should be measured from the saturation point. 

• Percentage changes of metrics such as phase bandwidth were used to determine 
failure detection times. Typical detection times (for 60% changes) ranged from 5 to 
12 seconds. Failures that resulted in PIO were detected in less than 2 cycles of the 
oscillation. 

Can the detection time be improved? 

• Yes, the technology has not yet matured. Reduced sensitivity to noise and initial 
conditions and automation are needed. 

Was information provided to the pilot? 

• No pilot alerting mechanism was implemented. 


7.4 Recommendations for Further Work 

Recommendations for improving wavelet theory include: 

• Improved coherence measures; 

• Improved Least Square/WERA parameter identification; 

• Multivariable identification; 

• Noise reduction; and 

• Reduced sensitivities to nonlinearities. 
Recommendations for improving wavelet applications include: 

• Implement digital wavelets; 

• Additional metrics; 

• Automated detection; 

• Pilot alerting; 

• Control room real time assessment; and 

• On-board simulator and flight test assessment. 
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APPENDIX A - ESTIMATION OF POWER SPECTRA AND TRANSFER FUNCTIONS 

USING WAVELETS 
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1. OVERVIEW 


Wavelet transforms can be used to estimate power spectra and transfer functions. Here we give formulas 
for the mean and variance of these estimates. Section 2 is a review of estimation of the statistics of 
random variables. Section 3 defines random processes and presents statistics of random processes that are 
used for power spectral estimation. Section 4 then review estimation of the statistics of a random process, 
including the auto-spectrum of the random process. The review material follows the treatment in Ref. 27. 

2. ESTIMATING STATISTICS OF RANDOM VARIABLES 
2.1 Single Random Variable 

A random variable x has a probability density function (pdf) p(x ) . The mean, mean square, and variance 
are functions of the random variable defined respectively by: 

M = E[x]= xp(x)dx 

ys 2 =E[x 2 ] = J ^x 2 p(x)dx 

cr 2 = E[(x-{i) 2 ]= f° °^(x-/i ) 2 p(x)dx = ip 2 -ju 2 
The standard deviation is cr . The moment generating function is: 

M{s)= ^e 5 X p(x)dx 

from which the moments can be found by: 


£[*']= ^x i p(x)dx = M (i) (0) 


2.1.1 Gaussian Distribution 

The most common assumption that is made about random variables in systems theory is that they have a 
Gaussian distribution, also called the normal distribution. The pdf is: 


/ \ 1 ~(x~p)/(2a 2 ) 

p(x) -7S‘ 

For shorthand use x ~ N(p,cr ) , where fi is the mean and a is the standard deviation. The standardized 
random variable is z = (x- fX)l a , which is z - N( 0, 1) . The probability distribution of z is: 


P(z a )^Ptob(z<z a )= ^p{z)dz = l-a 

which is usually tabulated as the area under the right-hand-side tail: 

l - p (z a )= JT p(z)dz = PTob(z> z a ) = a 
where z a is called the lOOcr percentage point. The error function is sometimes used: 
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elf(z)= ^'£‘ r “ 2<J “ • 



The area within one, two, and three standard deviations is: 

Prob (fi < z < m) = 0.6827 
Prob (-2a <,z<2<?) = 0.9545 
Prob (—3 <T<z< 3a) = 0.9973 


So less than 1% of the samples will be in the tails beyond 3a . The moment generating function for x is: 

M(s) = e sx+s2x2/2 

In the estimation problems we will use up to fourth order moments. The moment generating function (6) 
is used to derive the first four moments listed in Table 16. The remaining entries pertain to the case of two 
random variables. 


2.1.2 Chi-Square Distribution 

The sum squared of n random variables a ~ N( 0,1) is chi-square with n degrees of freedom: 

2 2 2 2 
Xn=t i +Z2+- + Z* 

This distribution is used in the estimation of variance. The pdf is: 

p(Z 2 ) = [2 nl2 nn/2)T 1 e-* ln (z 2 ) nl2 - 1 X 2 ^0 

where T(n/2) is the gamma function. The mean, variance, and the 100a percentage point are: 

a 2 , = 2 n 

X 

Q P(X 2 )dX 2 = Prob Qr 2 > zla) = a 

Xn\a 

For n greater than about 30 it follows that -^ 2 ^ 2 -Af(V2n-l,l). 


2.1.3 The t Distribution 

Define y - % 2 and z ~ N( 0,1) to be independent random variables and define the new random variable: 

yfy/n 

This is called the Student’s t distribution with n degrees of freedom. It is used in the estimation of the 
mean when the variance is not known beforehand. The pdf is: 


p(t) = 


r[(n+l)/2] 

yfzrn T(n!2) 



— (n+l)/2 


The mean, variance, and the 100a percentage point are: 
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M, =Q for n > 1 


2 n „ 

<7, = for n> 2 

n - 2 


r p(t)dt = Prob(f„ > r n;a ) = or 

The Student’s r distribution is very nearly N{ 0,1) for n greater than about 30. 

Table 16. Gaussian Moments 




Moment 

Value 

Zero mean 

For x~ N(/i,cr) 

E[x] 


0 

E[: c 2 ] 

ip 2 =cr 2 +/ 1 2 

<r 2 

E[x 3 } 

3cr 2 /u+ii 3 

0 

E[x A ] 

3<r 4 + 6 cr 2 // 2 + n A 

3cr 4 

For x - N(u x ,cr x ) , y ~ N(ju y ,cr y ) 

E[xy ] 

xy ~ ^xy + MxMy 

0 

E[x 2 y] 

¥ 2 x M y +2C xy M x ^ 

(^x~Ml)My+2R xy M x 

0 

E[x 3 y] 

2C*y¥x +(2(?x + Mx)M x M y = 
3R xy y/ 2 x + 6fi 3 x iiy 

SR^o- 2 

E[x 2 y 2 ] 

¥ X ¥ y "b 2(Cjy + 2.C xy /i x /i y ') = 

W 2 x¥ 2 + 2(Rl-ju 2 y y ) 

oWy+lRly 


For x { ,x 2 ,x 3 ,x 4 ~ N(fJ.,cr ) 

£[>! * 2 * 3 X 4 ] 

Q 2 Q 4 + ^13^24 + Q 4 C 23 +/^ 4 + 
i^ 2 (Cl2 + Q 3 + Q4 + Q 3 + ^24 + C 34 ) = 
^12^34 + E\ 3 R 24 + £ 14^23 “ 2// 4 

^12^34 + £l3 £24 + 
£i 4 £ 23 

E[x 2 x 2 x 3 ] 

(7 2 C23 + 2 Q 2 Q 3 +fl A + 

fi 2 (cr 2 + 2 Q 2 + 2 Q 3 + C 23 ) = 
\ff 2 R 23 + 2/? 12 /?i3 - 2// 4 

<J 2 /?23 + 2/?i2^l3 


If x and y are independent then C w = 0 and = /u x My ■ 
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2.2 Two Random Variables 

Two random variables x and y have the joint pdf p(x,y) . It follows that 

p(x)= , p(y)= ^ go P(x,y)dx 

from which the moments of x and y can be determined. The correlation and covariance function are 
defmed respectively by: 

Rxy = = £1 £.*»»(*. y^y 

Cxy = — Mx^(y ~ My )1 — ^xy ~ MxMy 

The correlation coefficient is an important parameter defined by: 


If the random variables x and y are independent then p(x,y) = p(x)p(y ) , and hence Rxy=MxMy, 

Cjy = 0 , and p^ = 0 . A weaker condition is if x and y are uncorrelated, defined by p^ = 0 . It is a 

weaker condition because uncorrelated does not imply independence, with the exception of joint Gaussian 
random variables. The moment generating function is: 

M (s,t)= ^^e sx+ty p(x,y)dxdy 

from which: 

£[*' y ; ]= (°° x l yi p(x, y)dxdy = M (0,0) 


2.2. 1 Joint Gaussian Distribution 

The joint or bivariate Gaussian pdf is a three dimensional bell-shaped curve: 

> 

The joint pdf expression is complicated, but fortunately we will not need to us it for any derivations. The 
moment generating function is more useful: 

M(s,t) = e N , where N = p x s+p y t+^(0’ 2 s 2 +2stC xy +(T 2 t 2 ) 

From which joint moments in Table 16 are derived. When x and y are independent it follows that 
Pxy =0 , C v =0 , = p x p y , and E[x 2 y 2 ] = . 

2.3 Estimation 

Different parameters of the random variable can be estimated from N samples x, of the random 
variable. It is assumed that the samples are independent and identically distributed (iid). Usually it is the 
moments of the random variable that are to be estimated. Call the parameter to be estimated S , and the 


p(x, y) = 


2mr & 


x 


-exp-< 


V 

x _ zl± 


- 2 P r 


y-M, 


X _Zjfx 

'V 


y-n. 


V 
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estimate S , using the hat to indicate the estimate. The estimate is itself a ra 


» r ith a mean, 


variance and distribution. The estimate is unbiased if the mean of the estimate equals the parameter, and 
consistent if the variance of the estimate approaches zero as the number of samples approaches infinity. 
The distribution is used to give confidence intervals to the estimate. 


The moments and errors used for parameter estimation are defined in Table 17. Note that the he mean 
square error subtracts off the parameter, whereas the variance subtracts off the expected value of the 
parameter. This makes the mean square error equal to the sum of the variance plus the bias squared. The 
root-mean-square (rms) is the square root of the mean square error, and the standard deviation equals the 
rms error when the estimate is unbiased. 


Table 17. Parameter Estimation, Definitions 


Mean 

E[S] 

Bias 

b[S] = E[S]-S 

Variance 

var[S] = E[(S - £[S]) 2 ] = £[S 2 ] - £ 2 [5] 

Mean square error 

£[(S -S) 2 ] = <r 2 [S]+b 2 [S] 

Root mean square error 

rms[S] = Jo- 2 [S]+b 2 [S] 

Normalized error 

e[S] = nas[S]/S 


2.4 Estimate of the Mean 

The random variable x has mean ju , mean square y / 2 , and variance O' 2 =y/ 2 — ju 2 . The random variable 
can have any distribution, except where explicitly specified as Gaussian. The estimate of the mean is: 





The moments and errors of this estimate are listed in Table 18. 


Table 18. Estimate of the Mean of a Random Variable 


Mean 


Bias 

b[fi] = 0 (unbiased) 

Variance 

var[/i] = <7 2 / N (consistent) 

Rms error 

rms[/}] = <x/VN 

Normalized error 

e[ju] = (a/M)/^JN 


2.4.1 Derivations 

The expected value of the estimate is computed as follows: 
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E[fi] = E 


1 N % i N i N 

=- 1 ^ 1=771 

i=l 


A/' 


i=l 




The expected value equals the parameter, and hence the estimate is unbiased. Similarly, the mean square 
of the estimate is: 


E[A 2 ] = E 


1 N l 2 i N N 
=— 


1=1 




It follows from the assumption of independence of the samples that 

E[x i ]E[x j ] = M 2 if i*j 
E[x?] = r 2 if i = j 

Hence: 


E[XjXj] = 




=1 

The variance of the estimate follows after substitution: 

n 2 


var[/i] = E 


{M-E[fi]Y 


=E{fi 2 ]-E 2 m=\-<j 2 

N 


The variance asymptotically approaches zero as N — » °° , and hence the estimate is consistent. 


2.4.2 Distribution (Known Variance) 

Assume the random variable ^ has a Gaussian distribution. The distribution of the estimated mean 
depends on whether or not the variance of the random variable is known. If the variance is known, it 
follows that: 


M-M 

oi4n 


= z~N( 0,1) 


Thus, the normalized expected value has the standardized Gaussian distribution. The Law of Large 
Numbers states that the same result is true when x has any distribution, or even different distributions, for 
large enough N. The distribution makes it possible to make statements like: 


Prob 


- s ^a 


= a 


This sets an upper limit for the estimate of the mean with a probability a that the estimate is above this 
limit. Common values are a = 0.10, 0.05, 0.01 respectively with z a =1.28 , 1.65, 2.33. The confidence 
interval is: 


M a ^L 2 <M<fi + a ^ 2 ~ 

The true mean will be in this interval with 100(1- or) % confidence, in other words, the probability is 
1 - a that the true mean is inside this interval. 
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2.4.3 Distribution (Unknown Variance) 

More commonly the variance is not known. Use instead the following estimate of the variance: 

1 N o 

a =—^T i (x i -fi) , where n = AT-l 
n i=l 

Assume the random variable x has a Gaussian distribution, and it follows that: 

Thus, the normalized estimate of the mean has a Student’s t distribution with n degrees of freedom. An 
upper limit of the estimate is established by: 

-a 

And the confidence interval for the true mean is: 


Prob 


li>- 


at, 


n\a 


Jn 






Gt n\all 

Jn 


<{l<£+ 


at n\a!1 

Jn 


2.5 Estimate of the Mean Square 

The estimate of the mean square is: 


i N 

^2 = J_y 2 


The moments and errors of this estimate are listed in Table 19. The normalized error for the expected 
value of the mean is (<7/ h)JUn , and here: JUn . Set a I ft — 1 , and we note in this case it takes twice 

as many samples for the same normalized error when estimating the mean square, as opposed to 
estimating the mean. 


Table 19. Estimate of the Mean Square of a Random Variable 


Mean 

m 2 \=v 2 

Bias 

b[ys 2 } = 0 (unbiased) 

Variance (Gaussian) 

var[yr 2 ] = 2(<r 4 + 2cr 2 // 2 ) / N (consistent) 

Variance (Gaussian, zero mean) 

var[^ 2 ] = 2 <7 4 / N (consistent) 

Rms error (Gaussian, zero mean) 

rms[ft 2 ] = a 2 j2/N 

Normalized error (Gaussian, zero mean) 

e[ft 2 ] = yf2/N 


2.5.1 Derivations 

The expected value of the estimate is computed as follows: 
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E[lfT 2 ] = E 

The expected value equals the parameter, and hence the estimate is unbiased. The mean square of the 
estimate is: 


1 N „ i N „ , N 

^ z=l j ™ z=l ™ 1=1 




i N l 2 1 At At 


N U 


tr*M 

This is as far as we can go in general, and so we assume jq - N(ju,<j) . From Table 16: 


2.2, 


Etfxj] 


3<t 4 + 6cr 2 /* 2 + fj* i = j 


[V* 


i*j 


hence: 


£[^ 4 ] = ^(3cr 4 + 6 <7 V + M 4 ) +^V 

and after some rearrangement: 

E[y> A ] = Y A +^(c 7 4 +2<rV) 

The variance of the estimate is: 

var[^ 2 ] = E[ys 4 ] - E 2 [y 2 } = £[^ 4 ]-^ 4 
Again assume Gaussian, and then substitute to get: 

var[ y/ 2 ] = (a 4 + la 2 /x 2 ) 


2.6 Estimate of the Variance 

Dividing by N gives a biased estimate of the variance. Dividing by n = N -1 fixes the problem. It is easy 
to unbias the estimate when working with random variables, but not so easy when working with random 
processes, so to provide a better analogy we present the estimates here both ways. If the mean of the 
random variable is known, divide by N, and there is no bias. If the mean is known to be zero, use the 
results for the mean square. 

2.6.1 Biased Estimate 

The biased estimate of the variance is: 


<r 2 = 


N 


N ■> 

E(*i-Ac) 


The moments and errors of this estimate are listed in Table 20. 
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Table 20. Biased Estimate of the Variance of a Random Variable 


Mean 

E[& 2 ) = (T 2 (N-1)IN 

Bias 

b[d 2 ] = -cr 2 / N (biased) 

Variance (Gaussian) 

var[d' 2 ] = 2cr 4 ( N - 1) / N 2 (consistent) 

Rms error (Gaussian) 

Tms[& 2 ] = <rj(2N-l)/N 

Normalized error (Gaussian) 

£[& 2 ] = j(2N-l)/N 


2.6.2 Derivations for Biased Estimate 

Add and subtract (i in the definition of a 2 and it follows that: 

N 


E[<r] = £ 


yv i-l 


= a 2 - var[/i] 


We already know vai[fi x ] = (T 2 / N , and therefore £[<r 2 ] = <j 2 (N -l)/ N . It is considerably more 
difficult to determine the variance. The variance expands to: 

var[<r 2 ] = £[<r 4 ] - £ 2 [<x 2 ] 

where: 

E[6 4 } = E[(y/ 2 ~/i 2 ) 2 ] = E[\fr A ] - 2 E[ys 2 fi 2 ] + E[fi 4 ] 

There are many terms to keep track of. It follows non-easily that: 

„ r . 4l 1 2 n N + 2 4 2(N + 2) 2 2 4 

£[yn = E £[<*,-]=— <x 4 + - ■ — - o-V + /t 4 


N N N 


N 


ct.2^2, 1 2 , W + 2 4 N + 5 2 2 4 

EtV' ] = — tXXE £ ^ *;**] = — ^<r 4 +— — cr 2 /z 2 +/i 4 

^ i=l;=U=l W 2 V 


£[/i 4 ] = -4- E ZEE £ U*y***f 1 = -^ 4 -*V 

A 1=1 y=ufc=i<=i N* N 


Add these up, most terms cancel, to get: 


Etd<]="-ZV 

N 2 


Subtract E 2 [& 2 ] , and finally: 


var[<r 


a4i N 2 -l_ 4 (N — Y) 2 4 2(N-Y) _ 4 

CT ] = —— CT -T—O =———(7 


N 


N 


N 2 
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2.6.3 Unbiased Estimate 

The unbiased estimate of the variance is: 

1 N T 

a 2 = — X( x i _ At) ’ where n-N -l 

n i = 1 

The moments and errors of this estimate are listed in Table 21. 

Table 21. Unbiased Estimate of the Variance of a Random Variable 


Mean 

E[& 2 ] = <7 2 

Bias 

fe[(j 2 ] = 0 (unbiased) 

Variance (Gaussian) 

var[<r ] = 2<T In (consistent) 

Rms error (Gaussian) 

rms[<r 2 ] = cr 2 -y/2/n 

Normalized error (Gaussian) 

£[& 2 ]=yf2ht 


2.6.4 Derivations for Unbiased Estimate 
Because 0^^ =(N / n)dl iased it follows that: 

E\.0 unbiased 1 = ^ n )E[&i mbiased 3 = & 

var l&Znbiased ] = (N In) 2 var l&biased 1 = 2 cr 4 In 
The second of these relies on the assumption that the distribution is Gaussian. 

2.6.5 Distribution of the Unbiased Estimate 

Assume that the random variable x has a Gaussian distribution, and then it follows that the unbiased 
estimate of the variance has the following distribution: 

-2 

gg =r 2 

y An 

a 

In words, the sample variance, normalized, is chi-square with n degrees of freedom. The confidence 
interval is: 

nd 2 2 n<J 2 
— ^ <~ 

_Xn\al 2 Xn\\-al2 _ 

We can use this chi-square distribution to back into the mean and variance results listed in Table 21. This 
is a good check on die results more laboriously derived using summations. The expected value and 

2 

variance of the chi-square distribution are respectively n and 2 n, hence the mean of <x is C7 In times n, 
and the variance is {c 2 In) 2 times 2 n. 
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3. STATIONARY RANDOM PROCESSES 


3.1 Definitions 

3.1.1 First and Second Order Moments 

The signals x{t ) and y{t) are defined as real, random processes. At each point in time these signals are 
random variables with a pdf. The mean of x(t ) , for example, is: 

H x {t) = £[*(/)] = £^x(t)p x (x,t)dx 

The most common assumption in system theory about this distribution is that is it a Gaussian distribution. 
What makes random processes different from random variables is that the pdf, and hence the moments, 
can change with time. In addition, and more importantly, the time signal x(t) at different times is related 
by a joint pdf, which in general depends on the different times. The auto-correlation of x(t ) , for example, 
is defined by: 


Rxxfa") ~ E[x(t)x(u)] = (x l ,x 2 ,t,u)dx 1 dx 2 

It the random process is stationary then the pdf does not depend on time, and the second order joint pdf 
only depends on the time difference. A good way to think of stationary random processes is that the 
statistics do not depend on the start time of the time signal. The first and second order statistics of a 
stationary random process x(t) are defined by: 

Mean: fJ. x = £[*(/)] = [~ xp x (x)dx 

Auto-correlation: R^r) = E[x(t)x(t + T>] = x 2 p XhX2 {x l ,x 2 ,t)dx ] dx 2 

Auto-covariance: C^fr) = £[0(0 - M x )(*(t + T) - // x )] = /^(r) - jU x 
Mean square: = £^(0) 

Variance: a x =(^(0) 

A less restrictive assumption is that the random process is wide sense stationary (WSS), which means that 
the mean does not depend on time, and the correlation only depends on the time difference, but no such 
restrictions are placed on the pdfs and higher moments. For theGaussian random processes being WSS is 
equivalent to being stationary. WSS random processes are defined by two statistics, the mean and the 
auto-correlation. The other second order moments can be determined from these two statistics. 

Now consider two random processes, x(t) and y(t) . Similar definitions to those above apply to y(t) 
when considered by itself. What is new are the cross-correlation and covariance functions, defined 
respectively by: 


Rxy( T ) = £[x(r)y(f + r)] = xyp^ (x, y, r)dxdy 

C^ir) = E[(x(t)-{i x )(y(t + t)~ n x )] = Rjyir) - fi x n y 
Three properties of the auto- and cross-correlation functions are of interest. 
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*«(-*) £ R xx<?) 

|^(T)| 2 < R^RyyiO) 

In words, the max im um value of the auto-correlation is T = 0, the auto-correlation is a symmetric 
function, and a bound can be placed on the cross-correlation. The same three properties are true about 
covariance functions. Replace R by C in the above equations. Define the correlation coefficient, which 
depends only on the time difference and is defined by: 

a x a y 



3.1.2 Complex and Vector Random Processes 

The random processes x(t) and y(t) can be complex, in which case the second order moments are 
defined using complex conjugation, for example 

Cross-correlation: (t) = E[x(t)y* ( t + r)] 

Cross-covariance: (r) = R^ (t) - JUxM* y 

The superscript * indicates complex conjugation. The auto-correlation and auto-covariance are real, but 
the cross-versions are in general complex. If the random processes x(t) and y(t) are vectors, real or 
complex, then: 

Cross-correlation: R*y(r) = E[x(t)y'(t + r)] 

Cross-covariance: (r) = R^ (r) - H x n' y 

The first order moments are vectors and the second order moments are matrices. The apostrophe y is 
defined as the transpose of the complex conjugate, also known as the Hermitian. For the real case the 
Hermitian is the same as the transpose. We use the apostrophe so that the same notation works for either 
case. (And this is consistent with how Matlab treats the apostrophe). Note that the same notation also 

works for complex numbers, since y* =y . 

3.2 Spectral Density Functions 

The energy in time signals can be converted to the frequency domain, leading to the definitions of the 
auto-spectra and cross-spectral density functions. 

3.2.1 Definition and Properties 

The auto-spectra and cross-spectra are the Fourier transforms of their respective correlation functions: 


The auto-spectra is real, non-negative, and symmetric (positive semi-definite in the vector case). The 
cross-spectra is complex, non-negative, and is symmetric if the indices are swapped: 

S xx (-f) = S* xx (f) = S xx (f)>0 
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S X y(~f) = S* xy (f) = S yx (f)> 0 
The inverse transform relationships are: 

Rxy(r)= [ l o S xy (f)ei 2 *f T df 
Set r = 0 in the inverse transform and it follows that: 

v^=R xx ( O)=[ oo s xx (f)df 


3.2.2 Non-Zero-Mean Case 

The definitions for the auto- and cross-spectra are true whether or not the underlying random processes 
have zero mean. It is helpful nonetheless to explicitly include the non-zero-mean in the equations, and 
what will be seen is that a random process with a non-zero mean will have an auto-spectrum with an 
impulse. The auto-correlation in the non-zero-mean case will be of the form: 

R xx (t) = C xx (t)+mI 

where fi x is the mean and the auto-covariance C^t) has zero-mean. The auto-spectra is: 

S xx (f) = S XX0 V)+fi 2 x S(f) 

where (/) is computed directly from the auto-covariance: 

S^(/)= £ m C„(f)e-M T dT 

It is for this reason that some of the upcoming results will use the auto-covariance in place of the auto- 
correlation. The variance is: 


<jl=C xx {V)=^S XXQ {f)df 

Of course all this bother goes away if the random process is assumed to be zero mean. 

3.2.3 One-Sided Spectra 

The one-sided spectrum is defined just for positive frequency, and is twice as high so that the total area is 
the same: 


G*</H 


2 $„(/) /> 0 

S„(f) / = 0 


[0 /< 0 


Some authors favor the one-sided spectrum, and so the definition is included here. We favor the two- 
sided version, and will use it outside of this sub-section. It follows via substitution that: 
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G„if) 


2^ a R xx (T)e~ i27rfr dT f > 0 

• /= o 

0 /<0 


Not having the “2” in the definitions when / = 0 is needed to properly handle impulses. In the non-zero- 
mean case it follows that: 


<?*(/) = 


25^(/) 

/£*(/) 


/>0 
/= 0 
/<0 


The inverse transform relationship is: 

R xx (*)=%G xx (f)eM T df 

The mean square value of x(t) is: 


*£-*=( o)=£g„(/W 

The definitions are similar for the one-sided Gyy (/) and <?*</)• 


3.2.4 Spectra Via Finite Fourier Transforms 

The spectra will be estimated, in fact must be estimated, from finite records. From the sample record 
Jt(r) , and similarly for y(f) , compute the finite time Fourier transform: - 

X(f,T)=£x{t)e- j2 * fi dt 


Define the following product: 


S xv (f,T) = ^X(f,T)Y\f,T) 


xy w 

The cross-spectra results from the following limit: 

V/)= lim EiS^fJ)] 

It is important to note that the limit is written in terms of the expected value. The above equality needs to 
be proven. The expectation moves inside the integrals: 

E[V/,r)]=^r £ £ E[x(a)x(/3)]e~ j27Cf ^~ a) dad/3 

Set ? = fi-a and it follows after some non-obvious machinations that: 

E[S xy (f,T)]= [JlJA\(t)e-j 2,c f T dr 

V 1 J 
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And then in the limit as T —>oo this lutegial becomes 5^(/) . Similar results hulu fui the auto-spectra 
s xx(f) and Syy(f) . 


3.2.5 Statistical Bandwidth 

There are many ways to define bandwidth. Qualitatively, the bandwidth is the width in frequency where 
the auto-spectrum has most of its power. When defining bandwidth we restrict attention here to a scalar 
(non-vector) random process. We also assume that the random process has zero mean. The particular 
definition of bandwidth that works the best for power spectral estimation is the so-called “statistical 
bandwidth:” 


£,«=</ w/ 

g,= L - , — ■*- 
2 £4(/w/ 

This equals: 

Bs Rl(0) 

That the numerators are equal follows from the very definition of the auto-spectrum. It is more 
complicated to show that the denominators are equal: 

J Si(f)df = jjlR„(a)R„(fie-M< a+ »dad04f 

= j Rl,(T)dT 

All of the limits of integration are from minus to plus infinity, and the integral with respect to / is first 
computed, resulting in the delta function. The next expression for the statistical bandwidth works whether 
or not the system is zero mean (which we state without proof): 

B . Cj( 0) 

2 JlL c « (t)t 

We give one more equivalent expression for the statistical bandwidth, which turns out to be the best for 
computation. Define the random process jcj(f) = x(t) * x(t ) , which is x(t) convolved with itself. Then: 

B £ Leo ) 

We are not quite ready to prove this, and we do so after better understanding the problem of passing a 
random process through a linear system. 


3.3 Linear System Response 

The input of a stable, linear system is defined as a random process, and the question is what can be said 
about the output. There are several important points: 

• The output is also a random process; 
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• The output spectrum is the input spectrum multiplied by the square of the system 
frequency response; 

• The output variance can be computed using a Lyapunov equation; and 

• So can the statistical bandwidth. 

Complicating factors are whether or not the input is white noise, has zero mean, and whether or not the 
system has zero initial conditions. We now present the full story, starting with the definition of white 
noise. 

3.3. 1 Definition of White Noise 

A white noise random process w(t) has no correlation between w(t) and w(t + r) , no matter how small 
the time difference. Think of it this way: if you know the response at time t, this knowledge provides no 
information about the response at time t + r , no matter how small the time difference. All that is known 
at any given time is the mean and variance of the signal. The random process has mean fi w and auto- 
correlation: 


R ww (r)=WS(r)+jul 

The quantity W is called the “intensity,” so a quick way to specify the random process is “white noise 
with mean ^ and intensity W ” The auto-spectra is: 

S xx (f)=W+^S(f) 


The spectral bandwidth is: 


B s 

White noise as infinite power, and hence is unrealistic, but white noise passed through a linear system 
nevertheless turns out to be a very useful and practical model for random processes. 

3.3.2 White Noise through a Linear System 

The input is white noise, non-zero-mean, and the initial conditions of the system are zero. The statistics of 
the output are listed in Table 22. The problem is defined above the double lines in Table 22, and the 
results are below the double lines. The results in Table 22 are a special case of the more general problem, 
presented next. 


3.3.3 Non-White Noise through a Linear System 

The input is a random process, non-zero-mean, and the initial conditions are zero. The statistics of the 
output are listed in Table 23. The derivation is now presented. 

The linear system has impulse response h{t) and Laplace transform H(s ) . It is traditional to present 
block diagrams using the Laplace transform, and we will follow this tradition. The Fourier transform 
H(f) is the Laplace transform evaluated at 5 = j2nf . It is with very little extra complication that we 
define the system very generally as being stable, non-causal, multivariable, and complex. (The 
complications are basically to keep the order of terms correct and to use an apostrophe now and then to 
indicate the complex conjugate transpose). 

The initial conditions are set to zero. A system with zero initial conditions is equivalent to one that has 
been operating for a long time, ideally since min us infinity, so that the initial condition response has 
decayed to zero. Only in this case is the output a stationary random process, and only in this case can the 
output spectrum even be defined. 
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Table 22. White Noise Through a Linear System 


W{t) * His) y(0 ► 

“ n yd ) ^ 

Input mean: 

Mw 

Input auto-correlation: 

R ww (t) = WS(t)+m x M'x 

Input auto-spectra: 

+H x M' x S(f) 

Output mean: 

My=H(0)^ 

Output auto-correlation: 

R yy (0 = h(a)Wh'(r +a)da+ /z^/4 

Output auto-spectra: 

Syyin^HifWHXn+tiyM'ySif) 

Cross-correlation: 

R yw (T) = h{T)W+JUyM^ 

Cross-spectra: 

S yw (f) = H(f)W + [i w tC6(f) 


Table 23. Non- White Noise Through a Linear System 


M( ° » His) W) ► 

“ n yd j 

Input mean: 

Mu 

Input auto-correlation: 

Ruu(T) 

Input auto-spectra: 

Suu(f) 

Output mean: 

My =H(Q)Mu 

Output auto-correlation: 

Ryy(r)= JT° ^h(a)R uu {t+a- pfi{J3)dadP 

Output auto-spectra: 

Syy(f) = H(f)S uu (f)H '{ /) 

Cross-correlation: 

Ry U (t) = £ h(a)R m (r - a)da 

Cross-spectra: 

Syu(f) = H(f)S m (f) 


The statistics of the output y(r) follow from the convolution integral: 

yto-^gictM-cQda 

The limits of integration start at minus infinity if the system is non-causal, and start at zero if the system 
is causal. The limits end at plus infinity because the input is assumed to start at minus infinity. The mean 
of the output is: 

M y = £[j0)3 = e|" T h(a)u{t -a)dcc\ 
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The expectation operator moves inside the integral, and it follows that: 

h(a)E[u(t-a)]da= h(a)M u da=H(0)v u 
The auto-correlation of the output is: 

R yy (r) = E[y(t)y\t + z)]= £ J ^h(a)E[u(t-a)u\t+r-fi)]h\fi)dad/3 

The limits of each of the two integrations start at minus infinity if the system is non-causal, and start at 0 
if the system is causal. This completes the derivation of the auto-correlation for the general case. If the 
input is white noise u(t) = w(r) then: 

Ryy(r) = £ £, h(a) [WS(T + a-fl)- /v4] h\p)dadp 

= |” h(a)Wh'(T + a)da - ju y ju' y 

The limits of integration start at minus infinity if the system is non-causal, and start at min(0,r) if the 
system is causal. Note that the auto-correlation in the white noise case is h(t)W convolved with h'(-t) . 

The auto-spectra result follows in a laborious but straightforward manner using the definition of the 
Fourier transform. The cross-results follow similarly and more easily using the convolution and the 
Fourier transform. 

3.3.4 Finite Time Response Using State Space Systems 

Next treat the more realistic case where a random process is applied to a system with non-zero initial 
conditions and the system is allowed to run for just a finite time. What we will find out is that the state 
and the output are random processes, but non-stationary random processes. The results are shown in 
Table 24. Only in the limit as the time interval extends to infinity do they revert to stationary random 
processes. In what follows the statistics of the state and output are derived. Probably the most important 
thing to note is that the steady state variance is the solution of a Lyapunov equation, and this is the best 
way to actually compute the variance. 

It is with no loss of generality that the input is assumed to be white noise. If not, model the non-white 
noise as the output of white noise through the system F (s) , and change the problem to the cascaded 
system H(s)F(s ) driven by white noise. Assuming that the input has zero mean restricts the problem, 
which is unfortunate, but the many extra complications that arise from removing this restriction do not 
outweigh the benefits. 

Model the system using state space equations, so that the initial condition can be more easily defined. The 
state space model is: 

x = Ax + Bw 
y = Cx 

The Laplace transform of the system is F(s) = C(sI -A)~ l B . The initial condition is x(tQ ) = xq. The 
state at some time later is found using the Variations of Parameter solution to the state space equation: 

+ f* 1 e A ^ l ~ T ^ Bw(r)dr 
•*o 
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Table 24. White Noise Through a State Space System 



Input mean: 

/Av = 0 

Input auto-correlation: 

Rww(T) = WS(t) 

Initial condition mean: 

Mx<fo) 

Initial condition variance: 

Qx( { o) 

Independence: 

C xw( t O>h) = 0 f° r *1^*0 

State mean: 

Mx ( f i ) = e A(<1 ~'° V* ( f o ) 

State variance: 

Q x (t ) = AQ x (t) + Q x (t)A' + BWB' 

State auto-covariance 

C„(M 2 ) = i a< ' l) ^ < ' ! “ ,> ' 2> - h 

Output mean: 

My(h) = CM x (.h) 

Output variance: 

Qy(t) = CQ x (t)C' 

Output auto-covariance: 

Cyyih’h) ~ ^^xxih’h^C' 


Note that once the state statistics are known the output statistics follow immediately using matrix 
multiplication, and hence we need only derive the results for the state. After some algebra it works out 
that the mean and auto-correlation of the state are respectively: 


Jr 0 

The mean changes with time, and hence the random process is non-stationary. Similarly, the auto- 
covariance depends on both q and t 2 , and not just on t 2 - q . To find the variance set t = t l =t 2 and then 
take the derivative with respect to t , and it follows that the variance satisfies the differential equation: 

Q x (t) = AQ x (t) + Q x (t)A' + BWB' 

with initial condition Q x Uq ) . Substitute back into the integral equation and then: 


Cxx^h’h) 


Q x (h)e A ' (t2 ~ tl) 

e m -‘2) Qx(h) 


h-h 
h <{ i 
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These results give a way to compute the non-stationary statistics. In the limit as t — » it follows that 
derivative Q x (t) = 0 the state variance settles to a constant: 


Q x = e At BWB'e Ar dr 

The variance can be computed from this integral, but a much better way that follows from the differential 
equation is to compute the variance as the solution of the Lyapunov equation: 

0 = AQ X +Q X A'+BWB' 

The input was defined to have zero mean, and the system is stable, so in the limit as t — > °° it follows that 
H x =0. The auto-correlation equals the auto-covariance, which is: 


Rxx(*) = C xx (T) = 






T>0 
T < 0 


Just to be clear we note the different ways to write the variance of the state: 

wl = R xx (0) = C xx (0) = Q x 

The variance at the output is: 

V 2 y = Ryy ( 0 ) = Cyy ( 0 ) = Q y = CQ X C' 


3.3.5 Computing the Statistical Bandwidth 

Starting with a state space description of a linear system, Lyapunov equations can be used to compute the 
variance of the output. Similarly, Lyapunov equations can be used to compute the output variance of the 
system cascaded with itself, and then these two variances are used to compute the statistical bandwidth. 
The cascaded system is shown in Figure 125. The input is zero-mean white noise with auto-correlation 
R ww (t) = WS(t) . Set W =1 . The statistical bandwidth has only been defined for SISO system, and so we 
assume that H (s) is such. The claim is that: 


B *&( Q) 

f 2^(0) 


w(t) ^ 


y(t ) ^ 


yi(0 

H(s) 

H(s) 




Hi(s) 


Figure 125. Cascaded System 
To prove this claim it needs to be shown that: 


\\(^=L.Rhh^ dT 

Now we know that Rhh( T ) = K?) * h'(-T) , where * is the convolution operator, and we know that 
\(f) = h(r) * h(r) , and hence: 
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(?) = h (?) * K (-T) = h(T) * k{7) * h\-T ) * k'(-T) 

Change the order of the convolutions, which can only be done for SISO systems, and then: 

R hh W = R hh (O * Rhh (*) = R hh (<x) R hh (* - a)da 


Set T — 0 and the claim is proved. To finish the computational method a state space realization for Hi(s) 
is needed. One such realization is shown below: 


ii = Ajv + Biw 

yi = Qw 


, where 


A = 


A 0 
BC A 

c 1= [o c] 


The two Lyapunov equations are: 


0 = AQ + QA' + BB' 


B l = 


B 

0 


and finally: 


0 = A l Q l + Q l A{ + B 1 Bi 


_ {CQC'f 
2 C x Q x C x 


3.4 Random Process Examples 

All of the examples are white noise through a linear time invariant filter. The general case is presented 
first, followed by two groups of filters. The first group is low pass filters, and the second group is 
bandpass filters. 

3.4.1 Filtered White Noise 

White noise is passed through a filter. The filter is linear-time-invariant, stable, SISO, in general non- 
causal, and complex, with impulse response hit) , Laplace transform H(s) , and Fourier transform 
H if) . The white noise has zero-mean and unit-intensity. The statistics for the general problem are listed 
in Table 22. The statistics for this version of the problem (SISO, zero mean, unit-intensity) are shown in 
Table 25. The same table also includes the statistics for a scaled version of the system. 

3.4.2 Bandwidth Limited White Noise 

The auto-spectrum is an ideal low-pass filter with a bandwidth of B Hz. The mean of the random process 
can be non-zero. The corresponding filter is non-causal. The statistics of interest are listed in Table 26. 

The figures in the table use parameter values a B -l, /x-0 

3.4.3 First Order Low Pass Filter 

Now consider a causal filter, the easiest being a first order filter: 

h(s) = — — 

s + a 

This is a low-pass filter with a filter bandwidth (-3 dB frequency) of B = a l{2n) Hz. The input is white 
noise with zero mean and unit intensity. The statistical quantities of interest are listed in Table 27. The 
figures in the table use parameter values 5 = 1 and a = b- 2 nB . 
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Table 25. Filtered White Noise (SISO system, zero-mean, unit-intensity) 


w(t) ^ 

H(s) 

yin . 





For the reguar system 

H(s) 

For the scaled system 
Hi(s) = PH {as) 

Impulse response 

h{t) 

*|(0 =-h{~) 

a \a) 

Auto-correlation 

R kh (T) = h(T)*h'(-T) 


Auto-spectra 

s«,(/>=|w>l 2 


Variance 


1C 
‘SaJ 43 

n 

V 

Dc power 

S hh (0) = H 2 (.0)=£ o R hh (T)dT 

S fhkl (0) = P 2 S hh (0) 

Statistical 

bandwidth 

B Rli 0) 

2 Zo R hhi T)dT 

B s =—B Sh 
s h a h 


Table 26. Bandwidth Limited White Noise 
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Table 27. First Order Lowpass Filter 

i 

0.8 
0.6 
0.4 
0.2 


Impulse response 


Auto-correlation 

^ (r) = |L<H+ 

2 a 

Auto-spectra 

b 2 

Shh(f)= 2 2 * 5 = J' 2jr f 

— s +a 

Variance 

** *<®-£ 

Dc power 

s»(0)=4 

a 1 

Statistical 

bandwidth 

5= 

ii 

& 




3.4.4 Second Order Low Pass Filter (Complex Poles) 

The exact solutions for the statistical quantities become cumbersome beyond just the first order filter. The 
solution is given nonetheless for the case of a second order lowpass filter with complex poles. The 
Laplace transform is: 


h(s) = - 


6 >* 


s z + 2 ^ cos + or 


The damping ratio is in the range 0 < £ < 1 , being Q = l/yfl for a Butterworth filter and C, = ~J?>I2 for a 
Bessel filter. The bandwidth is B = a /(2/r) Hz. The statistical quantities of interest are listed in Table 28. 
The parameter values used for the figures in this table are B = 1 Hz, co = 2kB , and £ =l/>/2 . 
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Table 28. Second Order Lowpass Filter (Complex Poles) 



3.4.5 Butterworth Filters 

High order Butterworth filters are used for lowpass filters with a sharp cutoff. As the order becomes 
higher, the Butterworth filter approaches the ideal lowpass filter of the same bandwidth, and therefore we 
expect the statistical bandwidth to approach the filter bandwidth. Indeed it does, as we see from the values 
listed in Table 29. The figures in the table are for a 10 th order Butterworth filter with B = \ Hz. 

The Matlab code (Version 6.5 with the control toolbox) used to compute the values in Table 29 is listed 
below: 


for n= [1:10, 15, 20] 

[a f b] =butter (n, 2*pi , ' s' ) ; 
sys^ss (tf (a,b) ) ; 
sys2=sys*sys; 

RhhO=sys.c*lyap (sys .a, sys .b*sys .b ' ) *sys. c 1 ; 
Rh2h20=sys2 . c*lyap (sys2 .a ( sys2 .b*sys2 .b' ) *sys2.c‘ ? 
Bs=sRhhO*2/ (2*Rh2h20) ; 

fprintf ( 'n=%d f Rhh0=%g 7 Bs=%g\n' , n # RhhO, Bs) 
end 
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Table 29. Butterworth Filters 



3.4.6 Bandpass White Noise 

The auto-spectrum is an ideal band-pass of width B Hz centered at / 0 Hz (where f 0 > B/2). The mean 
of the random process can be non-zero. The corresponding filter is non-causal. The statistics of interest 
are listed in Table 30. The figures in the table use parameter values <7 = 1, / 0 = 2, 6 = 1 , and ju = 0. 


3.4.7 Finite Time Fourier Transform (Rectangular Window) 

For the time series u(t ) , the Fourier Transform computed for the previous T seconds and at the frequency 
/o Hz is: 


U(M = l_ T u(a)e~ jljcf ^da 

This calculation is equivalent to the convolution U (/ 0 , t) - u(t) * h(t ) for: 


h(t) = 


(-j2xf 0 (T-t) 

jo 


for 0 < t < T 
otherwise 


The statistical properties of this filter are therefore important for studying estimation using the finite time 
Fourier transform. This transform is approximated by the FFT, and therefore this filter is also of interest 
for studying estimation using the FFT. This filter is called a “rectangular window” because the envelope 
of this filter is rectangular, begin equal to one over the time interval 0 < t < T and zero outside this time 
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interval. The statistical quantities of interest are shown in Table 31. The figures in the table use the 
parameters T = 1 and / 0 = 2 . 


Table 30. Bandpass White Noise 


1 

0.5 

0 

-05 

jwvsA^| 

1 t»*e 


o.« 

O.f 

o: 

i 

-0. 


■ ~ "i • : ■ 

f 

' L ' 



J •: 

■6 -4 -3 -2 -1 0 1 2 3 4. 

U -2 . • 0 . 2 

%■ 

Impulse response 

h(t) = cry[2B 

sin 7tBt ^ 
< JCBr , 

cos2xf 0 t+n 

Auto-correlation 

Rhh(T) = ° 2 [ 

sm7tBr'' 
tcBt j 

cos2#/ 0 t+// 2 

Auto- spectra 

Shh(f) = < 

<7 2 /(2B) \f±f 0 \<B/2 

U 2 S(f) /= 0 
0 otherwise 

. 

Variance 

C xx {0) = o 1 

Dc power 

£^(7)^ = 0 

Statistical bandwidth 

B S = B 


Table 31. Finite Time Fourier Transform (Rectangular Window) 


0:4 

ft2 

O 



? iv> A 

o4 ( \ 

"..4 V':.:.- _ ; 1 1 ; -1 

4 v n •• -. 

i 


J =2 -1 0 1 

3 -4 -2 0 2 4 


Impulse response 

... \e~ j2frfo(T ~‘ ) for 0 < f < 7 

h(t) = < 

\0 otherwise 

Auto-correlation 

a»w-j* +W(r -M ) ,or|l|sr 

[0 otherwise 

Auto-spectra 

Shh(f) = 

sin^(/-/o)rl 2 

M/-/o) J 

Variance 

Rhh(0) = T 

Dc power 

S«.(0)=f sin ' r / or l 

L K fo J 

Mr 2 if /o =o 

[0 if / 0 7 = integer * 0 

Statistical bandwidth 

B s =— 
* 47 
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The entries in Table 31 are derived. Start with the Fourier transform of just the envelope of the 
rectangular window: 


From which it follows that: 



0<r<T 

otherwise 


The filter impulse response is 


Use the transform identity: 


and hence: 


R(f) = e ~j*f T !E£lL 

*f 

0£r - r 
[0 otherwise 

h(t) = oce^ 2n ^ r{t) for a = e~^ 2n ^ T 


H(f) = aR(f-f 0 ) 


H( f) = e ~ Mf+fo)T sin;r (/-/o) r 

*/-/<>) 

The auto-spectrum is S(/) = |//(/)| 2 and the phase term drops out. Use the same transform identity to 
find the auto-correlation: 

Finally note that: 

[jRhhirf dt = 2 f (T - r) 2 dz = 

and hence: 

5 «m( 0) 3 

zFjRhhWfdT 4T 

3.4.8 Morlet Wavelet Transform 
Complex wavelets: 

For the time series u{t) , the Wavelet Transform is defined by the convolution: 

U(fod)= (” o u(a)h(t-a)da 

where h(t) = y/(t) and y/{t) is a scaled version of the mother wavelet <f>(t) : 

¥( t) = y[foX<Kfo t ) 
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Complex wavelets take the form: 

m = e~ jl7n g(t ) 

where g(t) is an envelope. The statistics of the filter h(t) , which ultimately depend on g(t) and the 
center frequency f 0 , play an important part of estimation using wavelets. 


Morlet Wavelet: 

The envelope for the Morlet wavelet is the bell-shaped curve: 


g(t) = 


_L_ e -t 2 /p 


This is a non-causal wavelet. The statistics are presented in Table 32. The figures in the table using the 
parameters / 0 = 2 Hz and ft = 4 . 


Table 32. Morlet Wavelet 



Derivation: 

The derivations of the Morlet wavelet statistics are now presented. Using a Fourier transform table we 
find that the Fourier transform of the envelope is: 

G(f,/3) = e-^* f)2 

Start with some transform identities: 
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=— g\ J—Jo- 


a 


a 


5(/) = -V 


a 


f-fo 




% W = c0e j27tc ^ r gic^t) * g(-a 2 t) 


%(0)= .QsVMt 

The 0 parameter is called out as a separate parameter, and a -yffo is defined to reduce the notational 
clutter. The mean square value is computed just from the envelope: 

*P *0 V 2 


V5? 


By substitution it follows that: 


/ l( f, y 0 )= _£ =e i« 2 ^-(« 2 O 2 /^ 


//(/,/?) =iexp 

a 

The auto-spectrum works out to be: 

S(f)=\H(f,0)\ 2 =±-H(f,20) 

This simplification is thanks to the properties of the exponential. The auto-correlation can therefore be 
found in terms of the filter impulse response: 

(r) = -h(t,lp) = 

a yjl 7tp 

More work is needed to find the statistical bandwidth. It follows that: 

R h 2 h 2 (r) = F~ l [s 2 (/)] = F" 1 [H ‘ *(/)] =-Lh(/A 0 ) 

from which: 


-0JZ 2 


f-fo 


V a - 


W°> = 


1 

fo4^0 


and the statistical bandwidth works out to be: 


B . R$h( 0) _ 1 f 

S 2 ^ 2 ( 0 ) 4^0 70 
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This finishes the derivation of the results in Table 32. 

Bandwidths and Standard Deviations: 

The filter impulse response h{t) and its transform H(f) are both bell-shaped curves, and it helps to 
understand curves by examining their standard deviations: 

Interpretations: 

• In the time domain, the number of cycles in one standard deviation of h{t) is ■J/31 2 . 

For example, if (3 = 4 there are two cycles in one standard deviation. 

• In the frequency domain, the center frequency of H (/) is /q, and the standard 

deviation is / 0 times ^2 / /? /(2rr) . For example, if /? = 4 and /o=10 then the 

standard deviation is / 0 !{2k^2) = 0. 1 1/ 0 = 1 . 1 Hz. 

• The statistical bandwidth is B s =\lx/2xo[H(f)] , which is about 25% larger than 

one standard deviation of H(f). For example, if J3 = 4 and /o=10 then the 

statistical bandwidth is about 1.4 Hz. 

• The center frequency of the auto-spectrum S(f) is the same frequency, / 0 , but 
being the square of H( f ) , the bandwidth is narrower, equal to / 0 times 

yJUj3/(2jt) . 

• The standard deviation in the frequency domain, and likewise the statistical 
bandwidth, scales with frequency. 11118 is one way to distinguish wavelets from 
Fourier transforms. The bandwidth for the finite time Fourier transform does not 
depend on frequency. 

4. ESTIMATING STATISTICS OF RANDOM PROCESSES 

Estimates are made of the mean, the mean square, and the variance of a random process. Each of these is 
a random variable with its own statistics. A narrowband filter is then used to estimate the auto-spectrum 
of the random process. 

4.1 Estimate of the Mean 

The stationary, real random process x(t) has mean fi and auto-correlation R^ij) . The estimate of the 
mean is: 

£ = j§ x (t)dt 
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The moments and errors of this estimate are listed in Table 33. 


4.1.1 Derivations 

The expectation operation moves inside the integral, so that the expected value of the estimated mean is 


E[ju] = E 


J £ x{t)d ? = ± £ E[x(t))dt =I£m=// 


Table 33. Estimate of the Mean of a Stationary Random Process 


In general: 

Mean 

E[£] = M 

Bias 

b[fi] = 0 (unbiased) 

Variance 

var ^^C xx {x)dt (consistent) 

Variance (zero mean) 

var[/i] « (0) / T (consistent) 

Rms error (zero mean) 

rms[fi] = ,JS xx (0)IT 

Normalized error (zero mean) 

e[£] = <X/M)JS„(0)/T 

For bandwidth limited white noise: 

Variance 

var [ju] = <j 2 /(2BT) 

Normalized error: 


For bandpass white noise: 

Variance 

var[//] = 0 

Normalized error: 

o 

n 

§ 

tj 1 


The mean square of the estimated mean is: 


E[£ 2 ] = E 


Set T-u-t and it follows non-obviously that: 


,-ti 

T 


Rxx(T)dr 


This is the exact solution, which it approximated for large T by: 


To determine the variance of the estimated mean use a similar derivation but with C„(t) : 
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var[£ 2 ] =i f r (l- f r C„(r)dr 


T J-r 


The results for bandwidth limited white noise follows because S^-CO) = cr 2 /(22?) . 


4.2 Estimate of the Mean Square 

The stationary, real random process jc(r) has mean fi , mean square y/ 2 = /? xr ( 0), and auto-correlation 
Rxx(t) . The estimate of the mean square is: 


The moments and errors of this estimate are listed in Table 34. 


Table 34. Estimate of the Mean Square of a Stationary Random Process 


In general: 

Mean 


Bias 

M^] = 0 (unbiased) 

Variance (Gaussian) 

varffi 2 ]”-^- (°° ^C^ t (r) + 2// 2 C xx (7)jdr (consistent) 

Variance (Gaussian, zero mean) 

vaitr 2 ] nciwi 

Rms error (Gaussian, zero mean) 

rms[y/ 2 ] = yj var[7 2 ] 

Normalized error (Gaussian, zero mean) 

e[y/ 2 ] =lly[BJ , B s = cl c (0)/[2^ o Cl c (r)dT} 

For bandwidth limited white noise: 

Variance 

var[</ 2 ] - (cr 4 + 2 /i 2 a 2 )/(BT) 

Normalized error (zero mean) 

£[//] = 1/VflT 

For bandpass white noise: 

Variance 

varjy 2 ] « cr 4 /(BT) 

Normalized error (zero mean) 



4.2.1 Derivations 

The expected value of the estimated mean square is: 


m\=E 


7 Jb * 2 «*] = 7 f E[x 2 (Wt = 1 %r 2 dt= V 2 


The estimate is unbiased. The mean square of the estimate is: 
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E[^ 4 ] = E 


Y l * 2w, l = ji Jb £ ^i')x\u)]dudl 


At this point assume the random process is Gaussian, and then from Table 16: 
E[x 2 (t)x 2 (u)] = yr A + 2 [C 2 , («-*) + 2^ (n 
Substitute, set T=u-t , and it follows that: 

£[1/ 4 ] =| f r ^l j[ci(r) + 2C K (r)// 2 ]^V 

This is the exact solution, which is approximated for large Tby: 


E[V*}~ | fjciCD + 2C xx (r)ii 2 ]dr+^ 


Next the variance: 


And since E 2 [\f/ 2 ] = \f/* it follows that: 


var [!/ 2 ] = £[^ 4 ]-E 2 [^ 2 ] 


var[^ 2 ] ~ ~ J Q[C^(r) + 2C tt (r)// 2 ]*/r 


4.3 Estimate of the Variance 

The stationary, real random process x(t) has mean ju , variance (7^(0), and auto-correlation /?**( t). 
The estimate of the variance is: 

The moments and errors of this estimate are listed in Table 35. 


Table 35. Biased Estimate of the Variance of a Stationary Random Process 


In general: 

Mean 

E[& 2 \ — G 2 - var[//] 

Bias 

b[a 2 ] = -var[/i] (biased) 

Variance (Gaussian) 

var[<7 2 ] = — |~ C:^. (r)dt - 2var 2 [//] (consistent) 

Rms error (Gaussian) 

rms[<7 2 ] = yj var[<y 2 ] 

Normalized error (Gaussian) 

e[& 2 ] = , B s =C^(0)/[2j^ci(TMT] 

For bandwidth limited white noise: 

Variance 

var[<7 2 ] * cr 4 /(AT) - <7 4 f[2(BT) 2 ] 
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Normalized error (zero mean) 

£[£]»! /Vfif 

For bandpass white noise: 

Variance 

var[^ 2 ] = cr 4 /(BT) 

Normalized error (zero mean) 

m = uJBT 


4.3.1 Derivations 

The expected value of the estimated variance is: 


E[a 2 ] = E 




= a - var [p] 


The estimate is biased. The variance of the estimate is more difficult. Follow the method used earlier for 
random variables. The variance expands to: 

var[<7 2 ] = E[<j 4 ]-E 2 [<T 2 ] 


where: 


E[a A ] = E[(\ff 2 -m 2 ) 2 ) = E[ys 4 ]- 2 E[y/ 2 fi 2 ]+ E[fi 4 ] 

It follows non-easily that: 

W 4 } = ^2 L [^E[x 2 (a)x 2 (fi)yia d J3 

= “T Co EL ~ vytBdP + 4 var [fi]{l 2 + yf 2 


E[yr 2 M 2 ] = ^2 L L ^E[x 2 (.cc)x{p)x{Y)]dadpdr 
~ 2 var 2 [£] + (<t 2 +5// 2 ) var[/i] +ju 4 +fi 2 cr 2 

£[ £ 4] = “2 r L Eo E. L E[x(a)x(/3)x(y)x(S)]dad/3dydS 
= 3 var 2 [//] +ju 4 + 6ju 2 var[/i] 

The approximation in E[yr 2 fi 2 ] is: 


pr EL Ec r^^-^ir-aHadPdr - 2var 2 [/2] 


Add the terms to get: 


£[<t 4 ] = <t 4 +4EE C i(^- a)dadfi - 2yr 2 var[//] - var 2 [/r] 


Subtract £ 2 [<t 2 ] , and finally: 


var[d 4 ] = -p- E„ C lc (fi ~ a)dccdp - 2 var 2 [fi\ 
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4.4 Estimating the Auto-Spectrum 

The objective is to estimate the auto-spectrum of the random process x(t) . The method use to do this is 
shown in Figure 126. The statistics of the estimate S^/q) are listed in Table 36. There is a fundamental 
tradeoff involving the statistical bandwidth B s of the narrowband filter. Reducing B s reduces the bias 
and increases the variance. 



Figure 126. Auto-Spectrum Estimation 


Table 36. Auto-Spectrum Estimate 


Mean 

%(/>«/># 

Rhh'y) 

Bias 

* z>2 

MS;«(/o)]®^S'(/o) (biased) 

Variance (Gaussian) 

varti^ (/ 0 )] = -1- Sldfo) (consistent) 

b S L 

Rms error (Gaussian) 

^4(/o)+*> 2 rS„(/o)] 

V 

Normalized error (Gaussian) 

«&,(/„)]. 1 + * 2 ^/o)] 

si(fo) 


4.4.1 Derivations 
Overview: 

The method for estimating the auto-spectrum is shown in Figure 126 and defined by the following steps: 

• x(t) is a zero-mean random process with auto-correlation ^(r) and auto- 
spectrum S^f ) . It is S^if) that is to be estimated at / 0 Hz. 

• hit) is the impulse response of a narrowband filter, with Fourier transform H(f ) , 
centered at /q Hz and with a statistical bandwidth of B s Hz. 

• The output of the narrowband filter is the random process y(t ) , which will have zero 
mean, auto-spectrum Syy(f) = |H(/)| 2 S^f ) , and mean square estimate: 

W 2 y=j^\y(tfdt 
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• The estimate of the auto-spectrum at the center frequency is: 

Expected Value: 

A 

We need to show that S^C/o) is indeed an estimate of q) . The expected value of the estimate is: 

E[SM o)]=-l—m 2 y ] 

K hhW 

where: 


E[y$] = tfi =Ryy(0)= [^Syyiftdf = £ S ^ (/ )S„ (f)df 

Substituting: 

£[s«(/o)l = £.S«(/)S»(/)4f 

K hh { V) 

And therefore we see that S^C/o) is an unbiased estimate of this integrated and scaled version of 
Sjccif) ■ Approximate the input auto-spectrum as a constant around the center frequency of H(f) : 

Then: 


E[S«(/o)l “ £s«(/W/ 

KhhVJ) 

The mean square value 0) equals the remaining integral of S hh (f ) , and therefore these terms 
cancel, leaving: 

E[S„(J { b)]-S„(/ 0 ) 

And so we have shown that ^(/o) is a biased estimate of S^C/o) • 

Bias: The bias is defined by: 

M^(/o>] = E[S„(f o)] - S„(J 0 ) 

which equals: 

This is an exact expression, and we look for an approximation. Set H (/) to the ideal bandpass filter, as 

defined in Table 30, which has S hh (f) = <r 2 /(2B) over then bandpass frequencies, R hh (0) = <J 2 , and 
statistical bandwidth B s = B . In this case: 

M4e(/o)] =Y -5«(/o) 


TR 1341-1 


158 


Replace 5 XC (/) with a third order Taylor series approximation: 

Sxxif) - + S«(/oX/ - /o) + 5'(/oX/ - /o) 2 /2 

All of the terms drop out except: 
from which: 


- B 2 

b[SM b)]*^«(/o) 

We note that the bias error is small where the auto-spectmm is smooth, and possibly quite large where the 
auto-spectrum has sharp peaks and valleys. 

Variance: 


The variance of the estimate Syy(f 0 ) follows directly from the variance of the estimate No new 
derivations are needed. The exact expression is: 




xvar[^] = — ^ — 

4,(0) 


2 ( T 

X — 

J j -T 


.-Ml* 

T 


yy 


(t)dr 


Again we look for an approximation. Let the time get large, so that: 

var[4(/o))--^x|£4( r Wr = - 5 L-xi£si(/)Si(/W/ 

K hhW 1 «W,(0) 1 

Approximate the input auto-spectrum as a constant around the center frequency of H(f) : 


so that: 


var[5^(/ 0 )] - 


S*(/W;a(/o) 


1 


4 ( 0 ) T 


x-l 4(/)4fxS^(/ 0 ) 


What is left is more succinctly written in terms of the statistical bandwidth: 

var[S„(/ 0 )]»-!-Sj,(/ 0 ) 

b S l 


TR 1341-1 


159 



APPENDIX B - TRANSFER FUNCTION ESTIMATION 
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1. INTRODUCTION 

Using data to estimate a transfer function, or a state space system, is one of the great problems of system 
theory, which you might think is by now a solved problem, but actually is still the subject of a 
considerable amount of research. Whatever works for one example, doesn’t work for the next, or is not 
fast enough, or is very sensitive, or falls apart when the problem becomes large, or does not adapt to 
changes in the system, and so further research is needed. You quickly get to the point where a set of 
estimation methods is needed, with some knowledge about when one method should be used, and not the 
other. 

The problem of estimating the parameters of a transfer function is treated here in a comprehensive way. 
Estimation of state space systems is also covered, but the major focus here is on transfer functions. If we 
can get that right, getting to the state space system requires just a slight modification of the method. We 
cover just the single-input single-output problem, which is difficult enough, and again if done right, the 
multivariable extensions are just another detail. 

The development starts with some background on the mathematical tools. The use of the pseudo-inverse 
to solve linear least square minimizati on is a standard part of linear algebra (e.g.. Ref. 39). The extension 
of the problem to errors that have a nonlinear dependence on parameters uses Gauss-Newton-Levenberg- 
Marquardt methods as detailed in Ref. 40. The background on orthogonal polynomials is from Ref. 41. 

The estimation problem starts with input and output data: 

Uj = input data 


y,- = output data 

defined for a set of time steps, and the object is to estimate the parameters of the z-transform: 


G(z) = 


b m Z m + —+ho 

z n +a n _ 1 z n ~ 1 -- + a 0 


Different parameter estimation methods are used from the main categories shown in Figure 127. 



Parameters: 

a i » 


Figure 127. Estimation Methods 

Time domain methods work directly with the input and output data. This is where the development starts, 
using the one-step prediction error method (e.g., Ref. 42). Frequency domain methods start with a 
frequency response, from which the parameters of the transfer function are estimated. A good set of 
papers that cover this version of the problem is Refs. 25, 43, 44. Markov parameters methods first 
estimate Markov parameters, which are the impulse response of the system, and from which the transfer 
function parameters are estimated. Some background material on Markov parameters is from Ref. 45, 
including their use to estimate transfer function parameters. Using Markov parameters to estimate state 
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space systems using the Eigensystem Realization Algorithm is covered in Refs. 24 and 46. Using discrete 
wavelets to estimate Markov parameters from time series data is discussed in Refs. 26 and 47. 

The different approaches are unified here and we show conditions where the time, frequency and Markov 
parameter approaches give exactly the same answer. They all have the same goal, so there ought to be 
relationships, but these relationships are not an aspect of the problem that receives much attention in the 
literature. The unifying concept is the minimization of an error, and the different methods basically 
amount to different weights on the error. 

The treatment here concentrates on several aspects of the estimation problem that often cause difficulty: 
estimation of the initial conditions, conditioning of the signals, and estimation of system order. Usually 
the assumption is made that the system starts with zero initial conditions, and when that is not actually the 
case, as it usually is not, answers go awry. One way around this difficulty is to estimate the initial 
conditions along with the system parameters, a harder problem, but solvable. Trouble often happens when 
signals are corrupted by noise, or by the influence of other inputs, or by the selection of sample size, or by 
the length of the time series. Some methods are not sensitive to these affects, and others, well, quickly go 
south. Signal conditioning includes filtering, or the use of Fourier transforms, or more recently and one of 
our areas of interest, the use of Wavelet transforms. 

2. MATHEMATICAL TOOLS 

The parameter estimation problem is posed as a problem where an error is minimized. The error is a 
vector, and it is the Euclidean norm of the vector that is minimized. The Euclidean norm is the square root 
of the sum of the elements squared, and hence, the parameter estimation problem is a “least square” 
problem. The mathematical tools that are reviewed here are: 

• Difference Equations: The parameters to be estimated are coefficients of a linear 
shift invariant difference equation, and we start by reviewing the general solution of 
this equation. 

• Linear Least Square: The error is defined as a linear function of the parameters to 
be estimated. The solution proceeds in one step by computing the pseudo-inverse of a 
matrix. The Singular Value Decomposition (SVD) is used to compute the pseudo- 
inverse. 

• Nonlinear Least Square: The error is a nonlinear function of the parameters, and an 
iterative minimization of the nonlinear error function is needed. The first derivative 
of the error with respect to each parameter is used in the solution. The Linear Least 
Square problem is a special case. 

• Orthogonal Polynomials: A linear combination of the parameters can be estimated, 
from which original parameters can be determined. One way to do this is to use 
orthogonal polynomials. This is done to reduce numerical errors. 

There are additional mathematical tools needed to help with the estimation problem, which are used to 
define a weighted error. These additional tools include filtering, Fourier transforms, and wavelet 
transforms. 

2.1 Difference Equations 

The linear, shift invariant difference equation is: 

yk = ~ a n-\yk-\ yk-n + b m u k-n+m + ' ' ' + h> u k-n 

The output depends on previous inputs and outputs. Assume the coefficients are known and the 
objective is to determine the solution of the difference equation. We are interested in the one-sided 
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solution, >’£ for k > 0 , given the input u- K for k> 0 and the initial conditions defined as y- K for 
-n < k < 0 . Problems that do not start at zero can be shifted to zero. The total solution equals a forced 
solution plus an initial condition solution: 

yk = y/ t + yic k 

total forced initial 
condition 


The forced solution solves the difference equation as stated above with zero initial conditions. The initial 
condition solution solves just the homogenous (no input) part of the difference equation: 


yk - ~ a n-iyk-l °oyk-n 

The initial conditions can be defined by n values of the output at any set of n times, not necessarily the 
times before the input is applied. We do so, however, because it is appropriate for simulation. The initial 
conditions can be packed into a vector: 


y-n 


yic ~ 


y - 1 


Qualitatively, the output for k>0 depends on the input from that time onwards plus an unforced part that 
somehow carries over from what happened before the input was applied. 


2.1.1 Solution using z-Transforms 

The use of z-transforms is usually accompanied with an assumption of zero initial conditions, but they 
can be used to determine the total solution. To find the forced solution, make the assumption of zero 
initial conditions and then the z-transform of the system is: 

U(z) z n + a n _ lZ *-i... + ao 

The z-transform of the input time series is: 

u(z) = Z{u *}= 

*= 0 

Multiply y(z) = g(z)u(z) and compute its inverse z-transform: 

y k =Z~ 1 {y(z)} 

To find the initial condition response, use the z-transform identity for shifted signals: 


z b*-l} = Z yk- 1* k =y-i+z ^(z) 

k=0 


z {yk-2}= Zft-2* k = y-2+z *y-i +z 2 y(z ) 

k=Q 
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Z {yk-n}= Y^y/c-nt k =y-n+Z V-n+l +’"+ Z " + V-1 + Z K Y(z) 

k=0 

Substitute this expansion into the homogenous difference equation. For a third order system: 

_ ~( a 2 + fl iz~ 1 +Qpz~ 2 )y-i -(«! +Qpz~ 1 )y-2 z£oM 

1 + a 2 z -1 + aiz -2 + aoz -3 

Compute the inverse z-transform of this expression to find the unforced solution. In general: 

-n(z) 


y(z)=- 


l + a„_iz 1 +--- + a 0 z' 


where 


n(z) = 


1 z 


-n 


°0 

a l 

a n - 1 

y-n " 

0 


: 

y-n+l 

• 


*•. aj 

• 

0 

... 

0 Oq 

. y-i . 


2.1.2 Solution Using State Space Realizations 

The general solution is much easier using state space methods. Convert the z-transform to the state space 
system: 

*fc+i = ^ + Bu k 
y k = Cx k + Du k 

The solution is written almost by inspection: 

x k =A k x o + £ A k ~ X ~ l B Ui 
i= 0 

For any state space realization, the initial conditions of the difference equation defined by the previous n 
output values are converted to xq by: 


xo = A n 


1-1 r- 


CA 


n - 1 


y-n 

L^-iJ 


The initial condition vector simplifies considerably when the observable canonical form realization is 
used. For n = 3 and m = 2 the state space realization is: 



-a 2 1 0 


V 

A = 

-a x 0 1 

B = 

h 


1 

1 

J 1 

o 

o 
1 


.bo. 

c = 

[100] 

D = 

[o] 


The initial condition equation simplifies to: 
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-aj -a 2 

-1 

y- 3' 

*0 = 

0 -Oq -#1 


y-2 


1 

O 

0 

1 

Ci 

o 

L _ 


_y- 1. 


2.2 The Linear Least Square Problem 

2.2. 1 Problem Statement 
The error vector is defined by: 

e = F6 - y 

The objective is the find the minimum norm parameter vector 6 that minimizes the weighted cost 
function: 

J=e H We 

The variables are: 

e = Nxl real or complex vector with components e ; 

0 = px 1 real parameter vector with components 0 i 
y = Nxl real or complex data with components y,- 
F - Nxp real or complex matrix 

W>0 = NxN real or complex positive semi-definite weighting matrix 

J>0 = real, scalar cost 

Comments: 

• The variables F and y are constructed from data, which can be real or complex. 
Estimation methods based in the time domain use real data and those in the frequency 
domain use complex data. In all cases the parameter vector 6 is restricted to be real. 

• The superscript H used in the cost function is the complex conjugate transpose, also 

rj •■p 

called the Hermitian. In the real problem e = e , the regular transpose. 

• The notation W > 0 means e H We >0 for all vectors. Because > is used, W may not 
be invertible. The weight may be real or complex, and is always symmetric 

(W =W H ). The diagonal elements must always be real, (otherwise W *W H ) so if 
there are complex elements they are always on the off-diagonals. 

2.2.2 Solution to the Real Problem 

The parameter vector that minimizes the cost function is: 

e = (WF) + Wy 

where (WF) + is the pseudo-inverse. The SVD is used to compute the pseudo-inverse. There are several 
variations to the problem depending on the dimension and rank of WF . The pseudo-inverse works for 
each of these variations, but each is still worth considering. It is noted that the rank of WF and not just 
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F needs to be considered, because W > 0 , and hence in general the rank of WF may be less than the 
rank of F . 

Square: 

WF is NxN and rank N . The inverse exists, the error is zero, the weight has no effect, and the unique 
solution is: 

0 = F~ 1 y 

Tall, Thin: 

WF is Nxp with p<N and WF has full column rank p . This is the usual problem we will encounter 
and it is the regression problem. The error is non-zero and the unique solution is: 

0 = (F T WF)~ l WF T y 

Short, Fat: 

WF is Nxp with N < p and has full row rank N . (This is not a problem we will encounter, but . . .) the 
error is zero, the weight has no effect, the parameter vector that achieves zero error is not unique, and the 
parameter vector with minimum norm is: 

6 = F T (FF T )~ 1 y 

Worst Case: 

Sometimes the regression problem degenerates to this worst case. WF is TV x p and the rank of WF is 
less than both N and p . The error is nonzero and the parameter vector that minimizes the error is not 

T T 

unique. Neither F WF nor FF are invertible, and the SVD is the only way to go. 

2.2.3 Solution to the Complex Problem 

This is not a problem that is encountered here, but for the record the solution is: 

0 = (WF) + Wy 

The notation is the same as for the real problem, but now the parts are complex. 

2.2.4 Solution to the Mixed Real and Complex Problem 

The error can be complex, but the parameter vector is restricted to be real. The problem is converted to a 
real problem with the error: 

_[R &(F0-y) 
e ~ Im {F0-y) 

The solution is: 


0 - 


Re(WF) 
Im (WF) 


Re(Wy) 

_Im(Wy)_ 


This is not the same as the real part of the complex solution. 
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2.2.5 The Singular Value Decomposition 

The pseudo-inverse is computed using the Singular Value Decomposition (SVD), which is now defined. 
The Nxp matrix WF has rank r and can be real or complex. The matrix WF is decomposed into three 
parts: 

wf=uzv h 

Each of the parts can be expanded into blocks with the dimensions as shown: 


p 

*[WF] 


r N—r 

*[UlU 2 ] 


N-r 


r p-r 

EjO 
0 0 



The block matrices are: 

Ui= orthonormal basis for range of WF 


U 2 = orthonormal basis for null space of (W F) H 
V\ = orthonormal basis for range of (W F) H 
V 2 = orthonormal basis for null space of (WF) 
Zi = diagonal matrix of singular values 


The singular values are nonnegative real numbers ordered high to low: <J l >-> a r > 0 . The linear least 
square problem is solved using the pseudo-inverse: 

N r r N 

p[(WF) + ] = ,[V{\ X r[zr ! ] X r [ut 1 ] 


2.2.6 Using the Null Space 

The pseudo-inverse gives the minimum norm parameter vector, which is a nice way to resolve ambiguity, 
but we will encounter “worst cases” where this is not the desired solution. All of the solutions that 
minimize the error are given by: 

9 = ( WF) + Wy + [Null(WF)]a 


where the vector a can be any rxl vector. Equivalently, using the parts of the SVD: 

9 = (y 1 I^ 1 uf)Wy+V 2 a 


The parameter vector 6 is minimum norm when a-0, and this is the only possible value for a when 
the null space has dimension zero. 

A variation of the linear least square problem uses just the null space. Consider the problem: 


F 


0 

V 


= 0 


A non-zero solution exists if the null space V 2 of F is non-trivial, in which case there must exist an a 
such that: 
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a 


~e' 


>21' 

v_ 


V22. 


Here the basis for the null space is further decomposed into blocks. Now if 77 is fixed and has the same 
dimension as the null space, and if the inverse of V 2 2 exists, then it follows that: 

e-v„vgti 


2.3 Nonlinear Function Minimization 

When the error is a nonlinear function of the parameters the minimization problem is more difficult, but 
hopefully worth the effort. One such complication occurs when the initial conditions needs to be 
estimated along with the parameters. The solution requires a good initial guess, usually found using a 
linear problem, partial derivatives need to be computed, iteration is required, and a stopping criterion is 
needed. It will be shown that each step of the iteration is not that different from the LLS problem just 
solved. 

2.3.1 Problem Statement 

The objective is to find the parameter vector 6 that minimize the error function: 

N 

•/(*) = 

i=l 


where: 


*i = yi-f(0>¥i) 

The Wj 's are weights, and the y, 's and Yi 's are measurements. All of the variables are real. The error 
function can be equivalently written as: 

J{d) = e T We 


where: 



e i 



0 ■ 

e = 


, w = 




_ e N _ 

■ 

0 

w N 


2.3.2 Taylor Series Expansion 

The solution method is to start with an initial guess 6 , and then to use the Taylor series expansion of 
J{6) to compute an increment 56 . The error function is expanded in two steps of a Taylor series: 


J (0 + 56) - J(9) - 56 t J3+^S6 t AS6 


The first derivatives fa of J (6) are packed into the vector f3 , and the second derivatives cty are 
packed into the matrix A . The components of the first derivative are: 


fa = 


-a/ 


N 

—o 2 


N N 
1=1 K 1=1 


mo.¥i) 

de k 
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Ssy that ths numhcr of parameters is p , and then the index is /c — 1, 
and vectors, it follows that: 


p . Equivalently, using matrices 


p = 2F T We 

where the partial derivatives are packed as follows into the Nxp matrix F: 




f —\ •: 






d6 p 


Next expand the second derivatives Ot k £ , where each of the indices is defined for 1 to p: 


a kt ~ 


dj _ a 2 



i=l 


dej dej 3e,- 

dO k dfy dd k d6t 


Note that the second derivatives of J use both the first and second derivatives of e ( - . Do not use the 
second derivatives of e t , partly to simplify the problem, and partly because Ref. xx argues that this is a 
good thing, leaving: 


N 

(=1 


dej 

d0 k de e 



i = 1 


d/( OWi) 

dd k de t 


The summation can be more easily computed, it turns out, using matrices that have already been defined: 


A = 2F t WF 


The problem essentially amounts to is computing the first derivatives of f (6,^) and lining these 
derivatives up properly in the matrix F . 


2.3.3 Iterations 

Having defined the derivatives, the iteration used to update the parameter vector needs to be defined. 
There are many ways to do so, of which we note three: 

Steepest Descent: 

Just use the first derivative, and slowly march down it: 

5a = piX 

The parameter X determines the step size. Setting this parameter is always troublesome. Too high? Too 
slow. Too low? Divergence. 

Newton-Raphson: 

If the current value of the parameter is close to a local minimum then a fast convergence is achieved 
using: 

da = A~^P 

What is close is not easy to know. Not close? Divergence. 

Levenberg-Marquardt: 
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A balance between the previous two approaches is defined by: 

8a = {Xl + A)~ l p 


The iteration proceeds by: 

• Initialize X=le6 (or some other value, large forces the initial steps to be small). 

• Compute 89 and J(0 + S0) . 


• Stop? 

• If J(0 + 86)>J(0), replace X with 3X (or some other factor) and jump to second 
step. 

• Otherwise, replace 0 with 0 + 80 , replace X with XI 3 (or some other factor) and 
jump to second step. 

Stopping Criterion: 

For all of these methods: 

• Stop after a fixed number of steps. 


And/or stop when ]£ 2 (a + 8a) ■ 


■Z 2 (a) 


is less than some threshold. 


• And/or stop when |£a| is less than some threshold. 


Local Minima: 

Local minima are always a problem, and there is no cure. Try a different initial condition, and/or smaller 
steps. Other minimization methods, such as genetic programming and simulated annealing, promise to do 
a better job of finding a global minimum. Well, maybe. 

Summary: 


SD: 8a = pi X — F T V/el X 


NR: 8a = A~ l p = (F T WF)~ l F T We 


LM: 8a = (XI + A)" 1 J3 = (XI + F T WF )~ 1 F T We 


2.3.4 The LLS Problem as a Special Case 

The LLS estimation problem should be a special case. Let us show that. The error function is: 

ei = yi-f{O,Vi) = yi-4>l0 

The matrix F of first derivatives is exactly the same matrix used for the LLS estimation problem. Start 
with an initial guess, it turns out any guess will do, but for simplicity set 0q = 0 , in which case the error 
of the initial guess is e=y . Use Newton-Raphson to update this guess: 

80 o = A~ 1 P = (F t WF)~ 1 WF t y 

We have shown that the LLS estimation problem, when posed in the more general form as a nonlinear 
minimization problem, converges in one step to the linear solution. 
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2.3.5 ivIiAcd Real and Complex Problem 

For time domain estimation all of the variables in the minimization problem are real. The problem needs 
to be extended to a mixed set of real and complex variables when used for frequency domain estimation. 
The solution at a high level is the same, but we go through the steps again being careful to keep track of 
what is real and what is imaginary. The statement of the minimization problem is: 

m= f>,Hf 

i=l 

where: 


ei = yi-f{0>Vi) 

The parameter vector 8 is real, the weights w,- are real numbers, and the function J (8) outputs a real 
number. The data y, and y/i can be complex, the function f(8,yr i ) outputs a complex number, and the 
error e { is also complex. The cost function can be rewritten: 


J(0) = e H We 

To solve this mixed real and complex problem expand the cost function as before using two terms of the 
Taylor series: 

J(0+ S8) = J (8) - S8 T p+^50 T A50 
The components of the first derivative for k = 1, . . . , p are: 


A« 


-9/ 

d8 k 

N 


£30* 


N 

1=1 

N 

=2>. 

1=1 


dfL_ 

‘ d0 k dO k 1 


M ^f(8,Wi) [ 

' dO k 30 k 


N 

= 2^w i Re 
i=l 






38, 


'k ) 


e. 


The last step follows because for the real derivative of a complex function the Hermitian and differential 
operations commute. To show this is the case: 

9 [/(*)]" _ d[/n(*)- = a/jg(jc) . 3fi{x) ( 3f(x) ') H 

dx dx dx ^ dx V dx J 

The subscript R and I respectively denote the real and imaginary parts. Next, write the first derivative 
using matrices and vectors as follows: 
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/3 = 2Re(F H We) 

where the Nx p complex matrix F contains the partial derivatives: 

\<h H 


F = 


LtfJ 


Ji 

. <Pi = 


HMVi) 


do 


p J 


The second derivatives of the cost function are: 

dJ 


a ki - 


dd k dO t 


N 


=y — — 

N 

-2£»iKe 
1=1 


Ji 


def* dei n de^ 
d0£ B0f c d0£ 


Don’t use the second derivatives of the error, so that: 


N 


<Xu =2^w z Re 

i=l 


df(d,i//j) ) H dfjd^j) 

do t 


V ) 


In matrix form it follows that the second derivatives can be packed into the pxp matrix as follows: 


A = 2Re 


F h WF ] 


The iterative solution to the nonlinear problem follows as before. For example, the update for the 
Newton-Raphson method is: 

SO = A~ l /3 

which can be expanded into several different ways: 

<50 = (Re[F H WF]) ^ejV^We] 

s-\ 


= (FrWF r + FjWFj ) _1 [FlWe R + FjWej ) 


'Fr 

T 

w 

o' 


M 

'Fr 

T 

'w 

o' 

«/t 

Ji. 


0 

w_ 

Ji. 

J v 

Ji. 


0 

w . 

M 


2.4 Orthogonal Polynomials 

Transforms are defined using polynomials. A problem with any polynomial is the powers are not 
orthogonal. The high order terms become almost linearly dependent, and hence high order problems are 
numerically ill-conditioned. It is better to not directly estimate the coefficients of the polynomial but to 
instead to estimate the coefficients of orthogonal polynomials. Define the polynomial: 
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n(x) = a n x n H 1 -Oq 

The same polynomial can be expressed as a sum of orthogonal polynomials: 

"00 = fn Pn (*) + ' • • + foPO (*) 

Any set of orthogonal polynomials will do, but the set usually recommended for estimation problems is 
the Chebyshev polynomials. This set of polynomials is optimal in the sense that reduced order 
polynomials minimize the maximum absolute value of the error. The Chebyshev polynomials are defined 
by the recurrence relation: 

p 0 (x) = l 

Pl(x) = X 

Pk (x) = 2xp k _ x {x) - p k - 2 {x) 

The series continues: 


Pl(x) = 2x 2 -l 
p 2 (x) = 4x 3 -3x 
p 4 (x) = 8x 4 - Sx 2 + 1 


Ps (x) = 16X 5 - 20x 3 + 5x 
p 6 (x) = 32x 6 - 48x 4 + 1 Sx 2 - 1 


The Chebyshev polynomials are orthogonal as defined by the weighted integral: 



■x 2 r 1,2 p m (x) Pn (x)dx= 


0 

7T 

nil 


m^n 
m = n — 0 
m~n & 0 


An important point is the integral has a finite range. The polynomials used in the transforms should be 
scaled so that the transform variable at least approximately has this range. 

Matrix operations can be used to convert between regular and Chebyshev coefficients: 


n(x) = a n x n + ■ ■ ■ + Oq = fnPn (*) + ■ ■ ■ • + foPO (*) 


where: 


For m = 3 : 


'<*n 


'fn' 

• 

= T 

• 

_ a 0. 


_/o_ 


~ a 3 ' 


'4 

0 

0 

O' 

h 

a 2 


0 

2 

0 

0 

h 

“1 


-3 

0 

1 

0 

fi 

. °o . 


0 

-1 

0 

1 

Jo. 
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The transformation matrix is computed using the Matlab commands: 

n=10 ; 

T=zeros (n,n) ; 

T (n-1 :n, n-1 :n) =eye (2 ) ; 
for i=n-2:-l:l 

T(i:n,i)«[2*T(i+l:n,i+l) ; 0] -T(i:n,i+2) ; 
end 

The transformation matrix is lower triangular, as is its inverse. 

3. TIME DOMAIN ESTIMATION 

3.1 Linear Least Square Estimation (One Step Prediction) 

3.1.1 Problem Statement 
Given the data: 

u k = input data, for /c = 0, . . . , TV - 1 
y k - output data, for = 0, . . . , /V - 1 

and the initial conditions: 

y k = initial conditions, for k - -n , . . . , -1 
the problem is to estimate the parameters of the transfer function: 

G(z) = !?wzW+ "' +fc o — 

z +a n _jz ••• + a 0 

which minimize the cost function: 

J = e T We 

and where each element of the error vector is defined by: 

e* = yk ~ 9k 

The estimated output y k is defined by: 

h = ~ a n-\yk-\ «0 yk-n + b m u k-n+m + — + b 0 u k-n 

This estimated output is the one-step prediction based on measured values of the previous inputs and 
outputs. 

3.1.2 Solution 

Convert the problem to standard form by sorting the data, initial conditions, and parameters into vectors 
and matrix. The difference equation is written more compactly using a vector inner product: 

where the </)[ vector contains data points: 

$ =[-yk - 1 - -yk-n “ k-n+m u k-n ] 

and the 6 vector contains the parameters: 


TR 1341-1 


174 


0 T =[ a n-l <*0 K ••• ftoj 
The error vector, called the prediction error, is equal to: 

e-y-Fd 

where the fa vectors are rows of the matrix F : 



The structure is best seen with an example, where for n - 3 and m = 2 : 


V 


-y-i 

-y-2 

-y- 3 

“0 

0 

0 

a 2 

y i 


-yo 

-y-i 

-y -2 

“1 

«o 

0 

«1 

^2 


-yi 

-y o 

-y-i 

“2 

“l 

«0 

°0 

^3 


-y 2 

-y\ 

-yo 

« 3 

« 2 

«i 

h 

j 


: 


• 

• 


• 

h 

ys j 



-yN-2 

-y^-3 

U N 

U N- 1 

U N- 2 . 

. b o. 


The estimation problem is a linear least square minimization problem, for which the solution is: 

e = (WF)+Wy 


3.1.3 Discussion 

Topics are addressed which will be covered in more depth in subsequent sections. 

System Order: 

If the system order n is known, then of course use it, but often this is not the case. Even if it is known, or 
at least approximately known, a lower order may be desired in order to obtain a reduced order model, or a 
higher order may be desired just to make sure the poles of the system are represented. Determining the 
order is an important practical problem. Four approaches that we have explored: 

• Solve the LLS problem for different orders, stopping when the cost drops 
significantly. 

• Use the SVD to determine the rank of F. If the input columns have full rank, and the 
matrix has column rank r, then the system order is n = r - (m + 1) . 

• From the a and b coefficients compute the Markov parameters, group these into a 
Hankel matrix, and use the SVD to determine the rank of the Hankel matrix, which is 
the system order. 

• From the Markov parameters form a high order state space realization, compute a 
balanced realization of this state space system, and then the r ank of the Grammian 
product is the system order. This is the best way to obtain a reduced order model due 
to guarantees on stability and due to error bounds. 

Any one of these methods will work just fine in the ideal case of data generated from models and 
uncorrupted by noise. The last of these is least sensitive to noise. 
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Numerator Order: 

The numerator order m must also be selected. Usually it suffices just to set m-n or m = n- 1 . A digital 
system formed by sampling an analog systems preceded by a zero-order-hold, a very common occurrence, 
will have m = n-l . If the actual numerator order is less than the selected m, then some of the higher 
order coefficients of the numerator will be estimated to be zero, or close to it, which is of little 
consequence. 

Number of Data Points: 

There are p = n + m + 1 parameters to be estimated. The minimum number of pairs of input and output 
data point needed is to estimate these parameters is p, plus the n initial conditions (u k for k = 0, . . ., p and 
y k for k = -n,...,p ). If the initial condition are not known then p + n pairs of data points are needed 
( u k and y k for k = 0, . . . , p + n ). Using the minimum amount of data makes the parameters very sensitive 
to the data. This sensitivity is reduced by using the regression problem with N » p . 

Initial Conditions: 

The problem is stated using initial conditions. If they are known, usually this means they are zero, include 
them as shown above. One of the nice things about the time domain estimation problem is that the initial 
conditions do not have to be known, in which case simply do not include the first n rows of e, y, and F. 

The Input: 

The columns of F that contain the input should have full column rank. If the initial conditions are used 
then this will be true (as long as «,■ * 0 for some i<N-m), thanks to the triangle of zeros in the upper 
right hand comer of F. If the initial conditions are not known and the first n columns of F are not 
included, then the input columns might lose full rank. The consequence of losing rank is that the 
numerator coefficients will not be accurately determined, and the system order cannot be determined. 
This will happen, for example, if a step input is used. For this reason the input should be “sufficiently 
exciting,” which is another way of saying the input columns should have full column rank. Sine waves, 
by the way, are not enough, though a sum of sines with at least m/2 different frequencies will work. 

Delay: 

The system may have a delay, and even if not a pure delay, high order dynamics in the system can be 
approximated as an “effective delay.” The z-transform has a delay of n - m steps, which means the most 
recent output that y k depends on is u k _^ n _ m ^ . Setting the difference n-m is therefore one way to force 

a delay. If the size of the delay is known to be d steps, then it is better to set m = n and multiply the 

denominator by the “pure delay” z~ d , and then just estimate the remaining a and b coefficients. In other 
words, the estimation routine should be helped out by not requiring that the denominator parameters that 
are known to be zero be part of the set of parameters to be est im ated. This is simply done by shifting done 
the input columns by d rows. 

Simulation Error: 

A common test is to run the measured input through the estimated system and then compare the output of 
the simulation with the measured output. The resulting error, called the simulation error, is not the error 
that is minimized by the LLS estimation problem. The problem as stated minimizes the one-step 
prediction error. The problem can be reformulated to do minimi ze the simulation error, but then this 
becomes a nonlinear problem. It is solved after further consideration of the linear problem. 
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System Changes: 

If the system changes the parameter estimates should also. The problem as stated, however, starts at time 
zero and uses all of the available data, in which case changes to the system will somehow be averaged. A 
better way to respond to changes is just to use the previous N data points; another way is to use a weight 
with an exponential “forgetting factor.” 

Stability: 

There is no guarantee that the estimated system is stable. Indeed, the ability to estimate an unstable 
system can be considered an advantage of the method. The problem, however, is that systems known to 
be stable can be estimated to be unstable. This can occur due to noise, or due to setting the system order 
too high. In either case, it is quite typical for the estimated system to have right half plane (RHP) poles 
and zeros that almost cancel. 

Why does this happen? Qualitatively, the one-step prediction is not “hurt” much by instability. The 
prediction is only one step, and a one step prediction error of an unstable system is not much different and 
in fact may be smaller than for a stable system. The simulation error, however, will be dramatically 
different, and even a “just barely” unstable estimated system can result in numerical overflow. 

There is unfortunately no good solution to the “false stability” problem. Several steps are nevertheless 
recommended to make a bad situation not quite as bad. 

• If the system is known to be stable then the solution can be restricted to be stable. 

First solve the unrestricted estimation problem. If the estimated system is unstable 
then map the unstable poles to their stable mirror images (opposite sign real part for 
Laplace domain poles, same phase inverse magnitude for z domain poles). This 
mapping is equivalent to solving the estimation problem using the autocorrelation. As 
a final step fix the pole locations and then resolve the estimation problem for just the 
numerator coefficients. 

• If the estimated system is stable then a reduced order model can be found via the 
balanced realization that is guaranteed to be stable. Stability is therefore not 
compromised when transforming the high order model. 

• Start the one-step prediction estimation problem with different system orders. Choose 
the one with the smallest simulation error. 

3.1.4 Generalization 

The one-step prediction problem is a starting point for the more general problem of parameter estimation. 
An overview of different types of generalization is presented below. 

Error Weight: 

The problem as stated is actually quite general - the generality being the choice W of the error weight, 
where: 


e = W(F0-y) 

The weight must be W > 0 , so that the cost J = e T We > 0 . The weight does not have to be invertible. 
Possible choices: 

• Restrict the set of measured outputs by setting parts of W equal to zero. This is what 
is done, for example, in “boxcar” averaging recursive estimation. 
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• Set the weight to \y = diag{or Af k }. This is what is done, for example, in the 
“exponential forgetting” version of the recursive estimation problem. 

• Filter the signals by setting rows of W to shifted versions of the filter impulse 
response. Filtering can be used to restrict the error to a given frequency range, or to 
filter out noise known to exist in a certain frequency range. 


• Replace sets of input and output signals with their average. This increases correlation 
between input and output by averaging additive noise. Do this, for example, by 
setting: 



1 ) ln avg 0 

0 (1 - l)/n m8 


• Switch to the frequency domain by setting the weight to the digital Fourier 
transformation, where the ki element is: 


W u = e ~ ijk2 * IN 


• The shifted signals in the data matrix are the same as multiplying the un-shifted 

signal by z~ k (except for a small end effect). Select a subset of the resulting Fourier 
coefficients to restrict attention to a given set of frequencies. Increase coherence by 
averaging adjacent frequency bins. Select a subset of averaged coefficients with the 
highest coherence. 

• Switch to the wavelet domain by setting the weight to a wavelet transformation. Use 
either continuous or discrete wavelets. Select a subset of coefficients to restrict 
attention to a given set of scales. Increase coherence by averaging scale coefficients 
(for discrete wavelets this is the same as using lower scales). 


In each one of these examples it is numerically faster to compute the transformations directly using the 
input and output time series and then rebuild the data matrix. Filter the signals, for example, and then 
rebuild the data matrix with the filtered signals. Use the FFT, for example, rather than the DFT, and then 
rebuild the data matrix from the FFT coefficients. 


Parameter Transformation: 

Insert a transformation matrix U and its pseudo-inverse as shown below: 

e = w[FUU + 6-y ) 

Use the pseudo-inverse because in general this transformation does not have to be invertible. The LLS 
solution is: 


U + 6 = (WFU) + ( Wy ) 

If U is invertible then the original coefficients can be recovered by 6—V (U~ k 0) . Reasons to do this 
transformation include: 

• Select a reduced order set of parameters by defining U to select a subset of the 
columns of F and the corresponding subset of coefficients. In this case U is not 
invertible and the full order solution cannot be recovered. 
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• Some of the parameters may be known, and a transformation can be used to restrict 
attention to the known parameters. For example, an integrator can be inserted by 
fixing one of the poles at (z-1), or zeros can be fixed at (z+1), considered the 
digital version of infinity because they transform to infinity using the inverse bilinear 
transformation. 

• Change from coefficients in polynomials of z to coefficients of orthogonal 
polynomials. This will improve the numerical condition of the estimation problem, 
especially for high order problems. In this case the transformation U is invertible. 

• Change from polynomials in z to polynomials in z-1 or S=(z-l)/h or 
S=(z-l)/(a) max h) or s = (2/T)(z— l)/(z+l) , and so on. This will improve the 
numerical condition by shifting the poles away from a cluster around z = 1 , and/or 
will allow direct estimation of a Laplace transform In this case the transformation U 
is invertible. 

Nonlinear Minimization: 1 

The nonlinear minimization problem can be stated in general using the error: 

e = f{6,u,y) 

which is a function of the parameters, input and output. The version that we will be using is the 
simulation error: 


e = W(y-y) 

where the simulated output is defined by: 

y(z) = G(z)u(z) 

or equivalently by a difference equation. In this case the initial conditions must be known or be estimated 
along with the parameters. Similar weights and parameter transformations as defined above can be used 
for the nonlinear problem. 

3.2 Determining the System Order 

3.2.1 Using Exhaustive Search 

The standard form of the LLS estimation problem assumes the following orders are known: 
m = numerator order 
n = denominator order 

Sometimes these quantities are not known, and one way to determine them is to perform an exhaustive 
search (i.e., check each possible combination). Comments: 

• Fill a two-dimensional table with costs J, and then pick the lowest n followed by the 
lowest m where the cost is less than an acceptable threshold. 

• Reduce the search from two to one dimension by setting m = n or "* = n - 1 

• Better would be an estimation method that allows the system order to be selected 
after preliminary calculations that do not depend on the system order. Fortunately, 
this can be done. 


TR 1341-1 


179 


3.2.2 Using Rank of Data Matrix 

Setup the data matrix F using n larger than the expected system order. Set m = n and then the total 
number of columns is 2n + 1 . Assume that the input columns have full rank, and that the actual order of 
the system is . The columns of F multiplied by parameters a,- for i > n x are linearly dependent on other 
columns, because each element of these columns satisfies the difference equation: 

Vk =-^-1^-1 Wk-ny +b m u k-n i +m+'-- + b Q u k-n l 

The rank of the matrix will reduce by one for each of these dependent columns, and the actual system 
order will reduce from n by the same amount. Say r is the rank of the matrix, and then the system order is: 

ny - r - (n + 1) 

3.2.3 Using Markov Parameters 

For a digital system the Markov parameters are the impulse response of the system. The Markov 
parameters can be computed from the a and b coefficients of the z-transform using a series expansion: 

G(z) = — — — — = b 0 + b l z l + b 2 z 2 +”‘ 

l + a„_jz •■• + a 0 z 

The h coefficients are the Markov parameters. Multiply through by the denominator: 

( b n + ■ + b 0 z ~ n ) = (l + a n _iZ -1 - - • + <*oZ~ n )(^o + + V” 2 + ■ ■ •) 


and then equate like powers of z: 


1 0 
«n-l 1 

<*0 

0 Oq 


0 0 
0 0 


1 0 
a n - 1 1 


k) b n 

K b n - 1 

K ho 

Ki+i o 


Invert the matrix with the a coefficients to determine the Markov parameters. Faster are to recursively 
compute the Markov parameters. Once found, sort the Markov parameters into a Hankel matrix: 

h h ••• h p 

h 2 h 2 h p+l 

H P ~ : • • : 


It follows that the rank of H p is n for any p>n, and therefore a sufficiently large Hankel matrix can be 

used to determine the system order. The singular values are the best way to determine the rank, and 
furthermore, the Eigensystem Realization Algorithm (ERA), which uses all of the parts of the SVD can be 
used to determine a state space realization of the system 

3.2.4 Why the Minimum Norm Solution is not the Best Solution 

The solution to the LLS estimation problem using the pseudo-inverse works for a data matrix of any rank, 
always giving a parameter vector that is minimum norm. Therefore, one approach is to select n larger than 
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expected, compute the minimum norm parameter vector, and then use subsequent calculations to reduce 
the system order. This is actually a good approach, but the point that needs to be made is that extra 
calculations are in fact needed because the minimum norm parameter vector is by itself not the best 
solution. A simple example will suffice to make this point. 

Consider the case where the system is known to be of the form G(z) = b/(z + a ) but in the regression 
problem orders n = 2 and m = l are selected. A transfer function of the form G(z)x(z + or)/(z + or) will 
be estimated. The parameter vector is: 

d T = [a + a aa b ba ] 

The a that minimizes the norm is found by setting d(8 T 0)/da = O to be: 


o 

1 + fl 

Ideally this a would be zero, because then the minimal order G(z) can trivially be obtained, but this is 
not the case, because a - 0 only when a = 0 . It follows that | a |< 1 , so at least the extra mode that is 
selected by the regress problem is stable. 

33 Initial Conditions 

Parameter estimation using the one-step prediction problem works using the total solution to the 
difference equation. This is important. We do not have to assume zero initial conditions. The system does 
not need to start at rest. The solution works with any initial condition and with tiny input, with one caveat 
- the input columns in the data matrix need to be full rank. A consequence of this generality is that the 
parameter estimation problem can be used “midstream” in a maneuver. 

Here this independence on the initial conditions is established, and then we argue that even though the 
parameter estimates do not depend on the initial conditions, the initial conditions are still important. 

3.3.1 Why they do not Matter for Prediction Error 

The parameter estimation solution for the one-step prediction error problem is 6 = (FW) + Wy , where the 
matrix F and vector y built from the time series samples and y k . The time series by definition of 
the problem satisfies the difference equation, and is therefore a total solution of the equation. The total 
solution takes into account the initial conditions, whatever they may be, zero or not. The matrix solution 
works for any solution of the difference equation, and therefore the parameters do not depend on the 
initial conditions. 

The above statement, while true, does constitute a mathematical proof. We will not attempt a rigorous 
proof, but will do so for a special case, which is suggestive of a general proof. Take the case where n = 1 
and m = 1 , and then: 


yk - 2 

u k - 2 

a 


yu- 1" 

Jk-l 

u k- 1. 

b 


_ yk . 


Solve for the parameters: 


TR 1341-1 


181 



a 

b 



1 

~yk - 1 

cA _ 
bA = 


-Wfe-2 

yk-2 


yjt-i 

. y* . 


~ u k-2 

yk -2 

a 

b 


a b 

'yk-i 

a b 

jk- 1. 


where A = yk-2 u k-l ~ yk-l u k-2 • What this shows is that any two sets of inputs and outputs can be used to 
estimate the parameters. There is no dependence on the initial conditions. 


3.3.2 Why they do Matter for Simulation Error 

The initial conditions are needed in order to simulate the identified system using the measured input, in 
order to try to duplicate the measured output. In other words, we need to know the initial conditions to use 
simulation to check validity. The resulting error between the measured and simulated output is called the 
simulation error. This is another measure of “goodness,” and arguably a better measure than the one-step 
prediction error. The simulation error indicates how well the estimated system will respond to different 
inputs, not just one step in the future, but for all future time. 


There is a subtle point that needs to be made about where to start the estimation problem. If the initial 
conditions are known then start the problem at k = 0 : 


yo 


-y- 1 

- -y-n 

u m-n 

— u -n 

a n— 1 

>n-l 


-y«-i 

... _y_j 

u m- 1 

- «-l 

°0 

y n 


-y n -i 

... — y 0 


- Uq 

K 

. ys . 


.-yN- 1 

"• ~yN-n 

u N+m-n 

1 

3 

1 

.bo . 


If the initial conditions are not known, however, then the estimation problem should start with k = n: 


~y n ~ 


-y n - i ••• ->o u m - «0 

a n - 1 



°0 

' 


. 

b m 

JN. 


-yN- 1 -yN-n - 1 u N+m-n u N-n. 

, 

- ^ 
1 


Sometimes these first n equations can make the difference between having full and reduced rank input 
columns. This will be the case, for example, if an ideal step input is used. 


3.3.3 Estimating the Initial Conditions 

If the transfer function parameters are known, then these parameters and the data can be used to estimate 
the initial conditions. Several ways to do so are listed. 
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Use the First n Inputs ami Outputs To Estimate the Initial Conditions* 

Use the data u k and for k>n to estimate the transfer function parameters. Then use the parameters 
and the data for 0 < k < n to estimate the initial conditions. Consider the case n = 3 and m = 2 , from 
which the general solution can be inferred. The difference equations for the first three outputs are: 


>0 


-y - 1 

-y -2 

-y-3 

0 

0 

o' 

yi 

— 

-yo 

-y - 1 

-y -2 

“0 

0 

0 



_-yi 


-y - 1 

«i 

«0 

0 


a 2 

*2 

h 

bo 


Rearrange these equations: 


°o 

«1 

a 2 

~y-3~ 


' i 

0 

O' 

yo 


0 

0 

o' 

«0 

0 

*0 

a l 

y -2 

= - 

a 2 

1 

0 

y\ 

+ 

h 

0 

0 

“1 

0 

0 

°0_ 

_y- 1 . 


_«1 

a 2 

1 

J2. 


A 

h 

0 

.“2. 


Invert the matrix on the left to solve for the initial conditions. The inverse exists if * 0 . The matrix 
equation for the general nth order system is: 


"«o 

*1 

°n-l 

~y-n 


' i 

0 

... o' 

yo " 


bn 

0 

... o' 

“0 

0 

% 

fl l 

y -2 

= - 

a 2 

1 

0 

y i 


b n- 1 

bn 

■*. 0 

Ml 

0 

... 

, 

o 

_y-i_ 


. a l 

... 

a 2 1 

_yn-i _ 


.^1 

... 

b n - 1 K 



The initial conditions are used to compute the initial condition response for k>0 , which subtracted from 
the total response gives the forced response. 

Use the First n Inputs and Outputs As A Surrogate for the Initial Conditions: 

Again use the input and output data for k>n to estimate the transfer function parameters. Compute the 
total response for k>n using just the input and output data from 0 <k<n . In other words, use the 
existing input for 0 < k < n , and then set u^ = 0 for k>n . The total response for k>n is equivalent to 
the initial condition response as computed above. The initial condition and forced responses can then be 
separated for k>n. This method has two advantages, extra calculations are not needed, and the result is 
not sensitive to the determination of system order. 

Use All of the Data to Estimate the Initial Conditions: 

Using just the first n data points makes the estimated initial condition sensitive to these data points. Better 
is to use all of the data to setup a regression problem, the solution of which is the estimated initial 
conditions. Use the data for k>n to estimate the parameters of the system. Simulate the system n+1 
times for k > 0 and label the outputs as follows: 

y = zero initial conditoin response to input u 
yi = response to initial condition y_j = 1 


y n = response to initial condition y_„ = 1 
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The measured response, which is the total response, equals: 


+ 

II 

- yn] 

y - 1 


F 

_y-n_ 



*0 


This completes the setup of the regression problem. Use the same weight used to estimate the system 
parameters, and then: 


Xo = (WF) + [W(y-y -)] 


Use State Space Methods to Estimate the Initial Conditions: 

The output of the digital state space system is: 

y k =CA k x Q +'YCA k - l - i Bu i 

i = 0 

Define y as the zero initial response and setup the regression problem: 


y = y + 


C 

ca n ~ 2 


F 


*6 


From which: 


x 0 =(WF) + [W(y- 50 ] 

3.4 Implementation of LLS Estimation Using Recursive Least Squares 

The parameter estimate at step k can be efficiently computed in terms of the estimate at the previous step. 
The resulting savings in computation time is a major benefit and has been one of the key reasons why the 
one-step parameter estimation method is popular. The problem statement in Section 3. A defined data for 
time steps 0 < i < N - 1 . The recursive version of the problem defines the data for k-N<i<k- 1, with 
the objective being to estimate the next output y k . In the following define: 


A k ~ 


The parameter estimate at time k using the square un-weighted solution is: 

0 k =(AiA k y\4h) 

Always using the previous N data points is called “boxcar” estimation, because the rectangular time 
window looks something like a boxcar rolling down the time line. The boxcar version of the problem 
adapts to changes in the system. Using all of the available data means that N grows with each step, and 
this is called “stationary” estimation, because this version of the estimation problem is appropriate for a 


4-n 


4-i 


, b k = 


yk-N+l 

L yk 
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stationary system. Another way to achieve an adaptive solution is to use a weight that exponential decays 
old data. This is the subject of the following section. 

We will present the recursive solution to the estimation problem but consider first a straightforward but 
naive implementation of the square solution. The matrix A* is of order Nxp , where p = n + m + 1 is the 
number of parameters. The required computations are: 


X = A[ A k requires Np 2 multiplications 
Y = At requires Np multiplications 
P k = X~ x requires p 3 multiplications 
6^ = P k Y requires p multiplications 
Total multiplications are p 3 + (N + 1) p 2 +Np . 

This is not terrible, because usually p is small, but with little extra work we can do better. Use the outer 
product to compute the intermediate terms X and Y : 


X ~ A k A k- 0k-N0k-N + • " + 0k-10k-l 
T 

Y = A k b k = <f>k-N Yk-N + • • • + fik-lYk 


And hence: 


r p r r 0 

X =X prev -fik-N-ifa-N-i + 0k-m-i requires 2 p multiplications 
Y = Y prev -<pk-N-iyk-N-i + 0k-\yk requires 2 p multiplications 
P k = X~ l requires p 3 multiplications 

A. r\ 

6 k -PkY requires p multiplications 
Total multiplications are p 3 +3p 2 +2p. 

The boxcar version of the problem (shown above) subtracts off the terms at step k — N. The stationary 
version of the problem does not subtract off these terms. The matrix inversion dominates either version of 
the problem, but as long as the total number of multiplications is less than about 10,000 (p less that about 
25) then with circa 2003 PC computers this does not pose a real-time problem. More likely p will be less 
than 10. 

The computational burden can be reduced still further, resulting in what is known as the “Recursive Least 
Square” algorithm. The key step is to use the Matrix Inversion Lemma: 

(A + BCD r 1 = A -1 -A~ l B{C~ x + DA~ l B)~ l DA~ x 


Set: 


A = Pkl i 

B ~ fa -l 
C= 1 


D = 4 - 1 


TR 1341-1 


185 



Then: 


n _ n h-xfa-xQk-lh-X 

*k ~ *k-\ r 

i+A-iPk-A-i 

Thus the matrix inversion can be updated with just a scalar inversion. The estimated parameter vector is: 

4 = P k A *h 


Substitute for P k and X[bk and it follows non-easily that: 


9k ~ &k -\ + 


h- lA-l 

l + tk-lPkA-] 


(j’ifc -^ T -A-i) 


This is the parameter update. There are some common terms that can be grouped together, and at each 
step the following calculations are made: 

&_i = requires p 2 multiplications 

= 4^-1 (l + 0k-i£k-l ) requires 2p multiplications 


A A T" A \ 

&k = S k- 1 + v k-\ yk ~ < Pk-\9k-i \ requires 2 p multiplications 


Pk = Pk - 1 - Vk-lZk-l requires p 2 multiplications 

rp A 

9k - fk 9k requires p multiplications , 

Total multiplications are 2p 2 +5p 

This recursive algorithm has reduced the problem from order three to order two, increasing the number of 
estimated parameters (within the budget of 10,000 multiplications per step) from about 25 to 70, which is 
about a three-fold increase. This improvement is not quite the Holy Grail of linear algebra, but still quite a 
good thing. The Holy Grail is a reduction down to order 1 . 


3.5 Exponential Weighting 

An alternative to boxcar weighting is exponential weighting. The advantage of exponential weighting is 
less data storage - you don’t have to keep the old data around in order to subtract it off N steps later. 
Perhaps not a big advantage these days, but let us continue. The exponential weight is introduced into the 
cost function: 


Z °^ l {9k-ykf 

i=k-N + 1 

What is the time constant? This is the number of steps until the weight equals e -1 , in other words, m such 
that a 7 ” = e~ l , which is: 

m = -1/lnor [steps] 

Set the step size to h seconds and then the time constant in seconds is: 

T = mh = -h/]na [secs] 
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Turning the problem around, the exponential weight in terms of the time constant is: 


a=e~ h,T 


In three time constants the weight is down to about 5%. Data before three time constants has little effect, 
unless there are anomalies like giant spikes, and three time constants is a good way to approximate the 
effective length of the input. 

Now solve the estimation problem. Rewrite the cost function as: 

J k =e I w k e k 


where W k is a diagonal matrix with the weights: 


W A .=diag(or iV_1 - a 2 a l) 
The weighted linear least square solution is: 

4 =PkA T k W k b k 

where: 


1 )" 

The update equations at each step change to:’ 

A k W k A k - aA k-\ W k-l A k-l + 0k-10k-l 
A k W k b k - aA k~) W k-\ b k-\ + fa-tfk 
Apply the Matrix Inversion Lemma as before to get: 

n Pk-10k-l0k-lPk-l 

Hc-1 t 

a+ A-\ P k-l l Pk-l _ 



&k ~&k-\ +* 


a+4-\Pk<t>k-' 


“0*-l4- 1) 


These are modest changes to the unweighted problem, increasing the number of multiplications by p , 
to a total of 3p 2 + 5p . 


3.6 Minimizing the Simulation Error (Nonlinear Minimization) 

3.6.1 Problem Statement 

A linear shift invariant digital system is characterized by the z-transform: 

y(z) _ fr m z w +-- + fco 
u(z) z n +a n _ l z n ~ l - + a 0 

and the difference equation: 

yk = ~ a n-iy k -i + K u k-n+m + — + 
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Given the time series «,• and y { - defined for i = 0,...,N -1, the objective is to estimate the parameters of 
the difference equation and the initial conditions y_„ to that minimize: 

N - 1 , 

J='Z{yi-yi) 

i = 0 


where y t is the simulation error: 

9i ~ ~ a n-\yi-\ — ^o9i-n + b m u i-n+m + ‘ ‘ + ^ 0 u i-n 

The simulation error problem differs from the one-step prediction error problem in the following way: 

• The previous outputs used to compute y, are estimated outputs - not measured 
outputs. This problem tries to match the measured output by playing back just the 
input through the estimated system. 

• The initial conditions are included in the parameters to be identified. If the initial 
conditions are known, then they can be removed from the list of parameters to be 
identified. 


3.6.2 Solution 

This is a nonlinear minimization problem. Use the general solution, with partial derivatives specific to 
this version of the problem. The cost function is rewritten: 

J(0)= X wrf 

i=0 

where: 


*i = - h 

9i ~ f Vi ) 

0 T ={y-n ••• y-l a n-l — «0 b m — b o) 



— M o) 


We need to compute the partial derivative of with respect to the parameters. Rather than use the 

function directly it is better to use the recursive formula for the output. The partial derivatives 

with respect to the z-transform parameters, for i = 0,...,N -1: 


jZ— = -yi-j-an- <*o for y = l,...,n 

da n -j da n _j da n _j 


ttm-j 


j%i - 1 


«»-;• “ a n- 1 TT 5 - 1 % for j = 0 , 

db m -j db m _j 


,m 


These partial derivatives are respectively the signals -%-j and u t _j passed through a system with just 
the denominator of the identified z-transform: 
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Partial(z) z n ^ 

9(Z) ~ z" +a n _ 1 z n_1 — HOq 

The initial conditions of this denominator-system are zero. The partial derivatives with respect to the 
initial conditions, for i = 0, . . . , N - 1 : 



a n - 1 


dy_; 


a 0 


d5i-n 

dy-j 


for j = -n, 


-1 


where: 


a \~ a n-H for 0<i<n-j 
[0 otherwise 

This is the initial condition response of the denominator-system. 


3.6.3 Partial Derivatives for First Order Problem 

The simulation output and partial derivatives are listed below for n = 1 and m — 1 : 


i 

h 

dy i Ida 

dyf/db 

8y,/dy_i 

0 

ay- 1 

y - 1 

0 

a 

1 

a 2 y_i + fc«0 

2a y-i 

“0 

a 2 

2 

a y_i+abu Q +bui 

3 a y_j +bu 0 

aiiQ + iq 

a 3 

3 

a 4 y_i + a 2 buQ + abu^ +bu 2 

a 

4 a y_j + 2abu.Q +bu\ 

2 

a uq + au\ + «2 

a 4 


The derivatives can be computed directly from the expansions of y, , or from the difference equations 
defined earlier. 


3.7 Time Domain Estimation Examples 


3.7.1 Ideal, Low Order Problem 


The unweighted, LLS, one-step prediction, time domain parameter estimation problem is demonstrated 
using a known system with data created by simulation. The system is the F-15 Active fighter aircraft, 
longitudinal axis, short period approximation, linearized at Mach 0.9, h=30000, U0=895 ft/sec, 
alpha0=1.84 deg: 


a 


'-.9543 

1 

a 

* 

-.1199 

-.0297 

-.0290' 

.9. 


7.1125 

-.7770_ 

.9. 

“T 

-12.44 

6.346 

-3.104_ 


stab 
5 can 
_ S noz. 


where: 


a [deg] = angle of attack 
q [deg/sec] = pitch rate 
6 [deg] = pitch attitude 
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^stab t ra d] = stabilator 
S can [rad] = canard 
S^z [rad] = nozzle 

s e = 8 Stab - 8 can + 8 noz = effective elevator 

Ideal actuators and sensors are assumed and a pitch SCAS is implemented as shown in Figure 128: 



e T 


Figure 128. F-15 Active Pitch SCAS (Low Order Approximation) 


With gains of [k q ^]=-.435x[l 3.5] the open and closed loop responses are: 


Open loop: -|- = 
8 e 


-21.9(0.993) 

(-1.8X3.53) 


Q 

Closed loop: — — = 
<V 


-21.9(0.993) 

(1.55)(3.39)(6.32) 


It is seen that the pitch SCAS stabilizes the unstable short period mode. The analog closed loop system is 
discretized using the ZOH equivalence and then simulated as shown in Figure 129. (The input is bandpass 
noise from 0.1 to 10 rad/sec, 3 seconds of zero on either end, no taper, sample period = 20 msec.) 



Figure 129. Time Domain Estimation (F-15 Active) 
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A z -transform is identified with 3 poles and 2 zeros, with parameter errors down in the level machine 
precision, and with similar small errors in the comparison of the raw and estimated outputs. 

The one-step prediction problem does not depend on the initial conditions. This is demonstrated by 
estimating the parameters using a mid-stream, two-second segment of the input and output time 
responses. The results are shown in Figure 130. The performance is equally good. Pretty much anything 
works for low order problems using simulated data. 



Figure 130. Time Domain Estimation with Non-Zero Initial Conditions 
3.7.2 Ideal, High Order Problem 

Expand the F15 example by using fifth order aircraft model and by including actuator and sensor models, 
but keep the estimation problem ideal by using simulated data. The pitch SCAS is shown in Figure 131: 



i 


Figure 131. F-15 Active Pitch SCAS (High Order) 
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The state space model for the aircraft has 5 states: 
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The additional variables not in the low order problem are: 

v [ft/sec] = forward velocity 
h [ft] = altitude 

q s [deg/sec] = sensed pitch rate 
6 S [deg] = sensed pitch attitude 

f a (s) = co 2 l[£ a , co a ] = actuator model with £ a = 0.707 , 0 ) a = 30 rad/sec 

f d (s)-(T d s 2 - 6 r d s + 1 2) /(r d s 2 + 6 r d s + 1 2) = 2 nd order Pade of delay with r d = 0.05 sec 

f q ( s ) = co 2 l[£ q , a) q ] = pitch rate sensor model with = 0.707 , (Q q = 300 rad/sec 

fff(s) = cog l[^ 0 ,Q)ff] - pitch attitude sensor model with = 0.707 , (O e = 100 rad/sec 

Of course the model can get even more complicated with higher order and separate actuator models, 
structure dynamics, and structure filters, and so on. Selected transfer functions are: 

O n loo q - 21 - 9 ( Q )( Q Q0165 X 0 - 0165 X° " 2 ) 
pen oop. ^ - (Q .0243X-0 .217, 0.0321](-1. 8)(3.54) 

_ , 6 -21.9(0.00165)(0.0165)(0.992) 

Open loop: — 

S e (0.0243)[-0.217,0.0321](— 1.8)(3.54) 

_ . . 6 -2.19e5(0.00165)(0.0165)(0.992)[0.707,30][0.866,69.3][0.707,300] 

Closed Iood: = — 

S €c (0.00134)(0.0166)(1.4)(3.73)[0.203,10.9][0.759,59.8](64.1)[0.706,100][0.707,300] 

Apply the same input as in Figure 129 and then estimate the transfer function. A plot of the raw and 
estimated outputs has a pixel or two difference between them, with both outputs looking just about the 
same as in Figure 129, and so a new figure is not needed. The estimation routine reported a one-step 
prediction error of 5.6e-8 and a simulation error is 0.991. The estimated transfer function converted from 
the z-domain to the Laplace domain is: 

6 _ 1.91e-6(0.995)[0.704,30](77.7)(-400)(457)(-506)[0.793,2.57e3](-1.28e4) 

S ec (1.32)(3.76)[0.205,ll][0.844,59.6][0.751,101](2.78e3)(2.48e4) 

The mid frequency modes between about 0.1 and 100 rad/sec are well represented, but not exactly, 
differing in the second or third significant digit. The lower and higher frequency modes are either missed 
or not correctly located. Of course these low and high frequency modes make precious little contribution 
to the output response, but the point is that the exact model is no longer estimated. The setup of the 
estimation problem used 10 poles, a relative difference of one, and used scaling and orthogonal 
polynomials. The high order estimation using a two second segment of data did almost as well. 
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When the estimation routine was directed to identify a fourth order system the result had a higher one- 
step prediction error of 2.2e-6, actually a lower simulation error of 0.673, and an estimated transfer 
function of: 

6_ _ -0.000203(1.76)(30.1)(-152)(-400) 

S ec [0.923,2. 86] [0.20 1 , 10.9] 

It is seen that matching the time response is easier then matching the pole and zero locations, which is a 
common theme in the world of estimation. 

3.7.3 LOCATS Pitch Response From Fixed Base Simulator Data 

An objective of this project is to test estimation methods using data from flight simulators and flight tests. 
Here we use data from a hardware-in-the-loop manned flight simulator for a large military transport. Run 
68 from the LOCATS data base described in Volume II of this study. The simulator is represented in the 
Figure 132 block diagram. 


DLON 

^ Large transport 
DLAT, Turbulence manned flight 
► simulator 


Figure 132. Manned Flight Simulator 

The pilot inputs are DLON and DLAT, the longitudinal and lateral stick positions in inches. There is a 
turbulence input, turned on for this run, and there is also an auto-throttle loop turned on for this run. The 
auto-throttle loop is an internal feedback inside the main block. Here the interest is the closed loop 
response from DLON to Q and THE, respectively pitch rate and pitch attitude. The simulator is 6 DOF 
nonlinear, with a full aero model and nonlinear actuator models, the actual flight computers, and the 
actual stick. The stick has a deadband, friction, and preload, worse in the lateral axis, but still present in 
the longitudinal axis. We have not tried to extract a linear model from the simulator documents, and so we 
do not have a “truth” model for this example. The flight condition for this run is lightweight cruise. The 
input is from a pilot performing a pitch-tracking task. 

The time responses compared with the estimated output are shown in Figure 133a. The fifth order 
identified transfer function for pitch attitude is: 

THE -0.00537(-9.91)(41.9)(-100)(-133)(1.53e3) 

DLON (0.07 95)(3 .2 1 )[0.507, 1 3 1 ](595) 

The fit is better when a higher order transfer function is used, but not significantly. The most notable 
feature in the estimated response is a significant low frequency error. 

Switch to the pitch rate, and the estimated output has a better fit. The estimated transfer function is: 

Q _ 5.43(10. 1)(-11.6)(-100)[-0.862 > 197] 

DLON [0.3 17,5.06][0. 172,105](8.3 le3) 

The dominant poles should be the same, or at least close, but this did not happen. The two output signals 
have synchronization errors, with many samples being help for two cycles, resulting in an increased 
signal-to-noise ratio. Pitch rate does better because it has more energy in the mid-frequency range. The 
frequency response of THE/DLON and the integrated Q/DLON are compared in Figure 133b. A 
significant difference is seen in the 1 to 10 rad/sec frequency range. 

Better estimation is needed, which is a good reason to switch to the frequency domain. 
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Input used tor identification 



Seconds 


a) Time Responses 



Fraq (rad/sec) 


b) Frequency Responses (of estimated transfer functions) 

Figure 133. Time Do main Estimation of Q/DLON and THE/DLON 
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4. generalizing the lls problem using weights 

The parameters to be estimated are coefficients of the z-transform: 

Git)- 

Z +a n -\Z ••• + Oq 

or equivalently the coefficients of the difference equation: 

= -{ a n-\yk-\ + • • • + Ooyk-n ) + ipm u k+m-n + '" + b 0 u k-n ) 

The linear estimation problem minimizes the weighted cost J = e H We with the error: 

e= y-Fd 


The vector y and the matrix F are built up from measurements of y k and u k for 0 <k<N . The 
parameter vector is: 

& T = { a n-l " ,a 0 b m ‘" b o) 

In this Section the error vector is generalized to: 

e = [y -FR]UU~ l 

which reduces to the former when R and U are both the identity matrix. The problem variations are 
determined by the choices: 

R = restrictions 

W = error weight 

U = parameter transformations 

It is rare that setting each of these weights to identity gives the best solution - usually just for low order 
academic problems. Choices for each of the weights are presented. 

4.1 Error Weights 

The error weight has been defined as part of the original problem. Now it is time to show that this weight 
is quite powerful. 

4.1.1 Time Variations 

The error weight can be defined to implement boxcar estimation. Define W to be a diagonal matrix with 
ones and zeros on the diagonal that selects the previous N inputs and outputs. The parameter estimates 
will then change if the system changes. The point to be made is that this variation of the estimation 
problem amounts to an appropriate selection of the error weight. Another point to make is that the 
solution in this case and for most cases that we will consider can be computed more efficiently than by 
just blindly using the general equations. Here the famous recursive solution to the estimation problem is a 
much more efficient implementation of the general solution. 

Similarly, the error weight can be defined to implement estimation with an exponential “forgetting 
factor.” Define W = diag{or w_1 } , so that previous inputs and outputs are multiplied by successively 
higher powers of a , where 0 < a < 1 . This solution can also be implemented recursively. 


1 

6 
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4.1.2 Averaging 

Adjacent inputs and outputs can be averaged and the average values can be used to estimate the 
parameters. Use the following error weight to compute a running average of n avg adjacent values: 

0l 


1 0 •. 

1 1 


and where W l 1 is the transpose of W 1 . The system that is estimated will be the same due to 
superposition and time invariance. In other words, the averaged output due to the averaged input will be 
the same as computing the averaged output from shifted versions of the input computed separately. This 
averaging will reduce the signal to noise ratio if a frequency separation exists between the signal and 
noise. 


w 122 =— t- 


avg 


1 0 - 
1 1 0 

1 \ 1 
0 1 \ 


The total weight is: 


w=w T, 2 w v 


T 


1 /o 


4.1.3 Filtering 

The running average is an example of the more general operation of filtering. Use the same filter on both 
the input and output: 


k k 

**k = ^j U ifk-i > Jjfc 

i = 0 i = 0 


This is the same as using the error weight: 


w 1,2 


fo 

f 1 
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0 

fo 
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o 

0 

fo 


0 

0 

0 


and where the total weight is W = w T, 2 W l/2 . It is more efficient to compute the filter response once and 
then build up the estimation problem using the output of the filters. This filtering will reduce the signal to 
noise ratio if a frequency separation exists between the signal and noise. 

4.2 Frequency Domain Estimation 

4.2. 1 Transforming to the Frequency Domain 

Linear least squares estimation in the time domain minimizes the one-step prediction error. The same 
problem can be posed in the frequency domain. Here we define a weight that transforms the time domain 
problem into the frequency domain. It will turn out that the weight is a factored version of the identity 
matrix, and so the transformed problem will give exactly the same answer. 

Define the digital Fourier transform (DFT) and its inverse: 
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V-1 


I 1 = l¥' P "* . 

1=0 N k=0 

The DFT can equivalently be written as a vector inner product: 


N-l 


-t 


1 


7 -(n- 1 ) 


f x Q ^ 


\ x N-lJ 


where = e ^ 2nlN . Build up the weight using the row vectors of the inner product. Define the weight as 

W = W h,2 W 1,2 /N where: 


W 1/2 = I 


T 

w 0 


T 

_ W N - 1 


. w l =(l 


-k(N-l)) 


Multiplying by the weight W 112 is equivalent but slower to using the Fast Fourier Transform (FFT), so of 
course in the implementation we will use the FFT, and the weight is a theoretical device that will not 

actually be implemented. The division by N is needed because w\ =N . It follows that the total 

weight W = / , so by using this weight the solution is not changed. What this weight allows us to do is 
transform the error to the frequency domain: 

E = W U2 e = W ll2 (F0-y) = W l,2 F0-Y 

The solution in terms of the transformed error is: 


Re(w 1/2 F) 

+ 

Refr)' 

Im(w 1/2 F) 




The optimal cost is equivalently stated in the time and frequency domain: 

J = e T e = E H E/N 


This equivalence is called Parseval’s theorem. 

To summarize, the DFT has been computed of the output vector y and each of the columns of the data 
matrix F, which transforms the problem to minimizing the frequency domain error between the output 
and one-step predicted output. With these transformations the time and frequency domain solutions are 
exactly the same, but there is as yet there is no practical benefit to doing this transformation. There soon 
will be, however, when a subset of the frequency response is used to filter the measurements, and 
averaging in the frequency domain is used to reduce the effects of noise. In addition, under certain 
conditions that we now explore the DFT of the input and output only needs to be computed once. 


4.2.2 The Transformed Data Matrix 

The data matrix from the time domain problem is: 


TR 1341-1 


197 



F = 


4 


<Pn - i 


> $i ~ ( ^i-1 ‘ ' ' yi-n u i+m-n ' ‘ ‘ u i—n ) 


A key observation is that the columns of F are delayed versions of the input and output, and it will turn 
out under certain conditions that: 



where z 1 is the shift operator. If these as yet unnamed conditions are true, it follows that: 



The FFT of the input and output only have to be computed one time and then the data matrix is built up 
from the FFT coefficients and the powers of the digital frequencies. In addition, we can divide through by 
U k , call G k =Y k /U k the estimated frequency response of the system, and transform the problem into 
one of minimizing the frequency response of the system. 

Now let us examine the conditions for which the above equation is true. Expand one of the elements of 

W F , choose say the k2 element, and from this develop a general pattern. The DFT of the k2 element 
is: 


(i ... *;<"-'>) 
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N - 1 
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extra terms assumed to be zero 
Note that z k N = 1 , and then it follows for m = n that: 
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Therefore, the equation is true if cx k =0 and J3 k = 0 . Basically, the first and last n inputs and outputs 

need to be zero. If so, the solution of the frequency domain estimation problem using this equation will be 
exactly the same as the time domain, one-step prediction error minimization problem. 


4.3 Restrictions 

Restrictions are used when parts of the transfer function have a fixed form, such as a known relative 
order, a delay, an integrator, and/or zeros at infinity. In each of these cases the practical affect is to reduce 
the number of parameters for the estimation problem. The error vector is: 

e = y- FR6 

and the solution of the LLS estimation problem is: 

d = (WF/?) + (Wy) 


4.3.1 Relative Order 

The relative order of the z-transform G(z) is the difference n—m. This difference corresponds to a 
digital delay of n - m steps, in the sense that the input u k does not affect the output until that many steps 
later. One way to interpret the numerator is as an nth order polynomial with the high order coefficients 
restricted to be zero. The estimation problem can be setup using the nth order polynomial and then 
“asked” to estimate these high order coefficients; alternatively a restricted version of the problem can be 
defined using: 


R6 = 


I 0 
0 0 
0 1 




a n-l 

a n - 1 


4 ) 

oo 
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K 


0 

- b 0 . 


b m 



. 


You could form this R matrix and carry out the matrix multiplication FR , but it is easier to just select the 
last m columns of the input. This is what we have been doing all along. 


4.3.2 Delay 

Assume that the input is delayed by d steps, which changes the z-transform to: 

z -i 

-W i - _ Tl 1 | 

z +a n-l z 
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The order of the system increases to n + d , but there is no need to have the estimation problem find the 
denominator coefficients that are known to be zero. Restrict the parameters using the following R matrix: 


a n — 1 


Rd= 


1 0 
0 0 
0 I 


a n - 1 


% 


*0 

0 


b o . 


bo 


This restriction looks the same as used above to define a relative order, but this time the extra zeros 
“belong” to the denominator. The error vector is: 


e — y- FRO = 


>o ' 


-y- 1 

••• -y- n 
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a ... 

a n- 1 

y n - 1 
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_ b o 


The best way to form the matrix FR is just to shift the input down by d steps. There is no need to actually 
multiply the original matrix F by a bunch of ones and zeros. 

Converting From Analog to Digital Delay: 

Consider the case where an analog system with a delay of f seconds is converting to a digital system 
using the ZOH equivalent transformation. The block diagram is shown in Figure 134. 



Figure 134. Conversion of an Analog System using a Zero Order Hold 


The z-transform has the form: 


y(z) _ fr„z n +---+i\) -a 

u(z) z n +a n _ lZ n ~ 1 - + a 0 

The order n is the same as the order of the analog system. The analog delay is: 

r = d A-ju 

where A is the sample period and 0 < (J. < A . The analog delay is fi less than d full sample periods. Note 
that both the numerator and denominator polynomials have the same order n. 
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Estimating the Delay: 

Step through different values of d and choose the delay that gives the smallest error. Decrease the number 
of times the linear problem is solved by using a trisection search for the min imi zin g delay. 

4.3.3 Zeros at Infinity 

Define the z-transform to be of the form: 


G(z) = 


z n +a n _\z n 


The zeros at z = -1 are called “zeros at infinity.” The numerator is nth order but only m parameters need 
to be estimated. Define the restricted set of parameters: 


/ o U 


where for m = 2 and n - m = 1 : 


and for m = 2 and n-m = 2 


R u h = 


R u h 1 = 


1 o o 
1 1 0 
0 1 1 
0 0 1 


1 0 0 
210 r &2 
12 1 *! 
0 1 2 
0 0 1 


A pattern emerges; the columns of R u contain coefficients of (z+l) n m . The easiest way to form the 
product FR is to successively add columns of u. 

Interpretation of Zeros At Infinity Using Laplace Transforms: 

Define the Laplace transform: 

/^f + ^ +d i e 

s +c n _jS ••• + £() 

The relative order n-m equals the number of zeros at infinity. The term “zero at infinity” means that for 
large s the magnitude of the transfer function approaches zero. Defining an “order” for this zero has the 

interpretation that for large s the transfer function is approximated by d m /s n ~ m . The relative order 
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determines the high frequency characteristics of the Laplace transform. The magnitude has a high 
frequency roll-off of 20 (n-m) dB/dec and the phase asymptotically approaches -90 (n-m) degrees. 
Now convert the Laplace transform to the z-domain using the bilinear transformation: 

G(z) — G ana i og (s)| (2/A)(z— 1) 

(z+D 

where h is the sample period, and to go the other way: 

G analog ( s ) = ^(^)| s+ 2/h 

~-s+2/h 

The z-transform will have a set of zeros at z = -1 : 

(* + l)— (Jwz»+- + J b ) 

0(Z)= 4^ ; ' 

z +a n- \ z +--'+b 0 

These zeros are considered to be “digital zeros at infinity.” The z-transform can be defined to have n — m 
digital zeros at infinity, which will in turn specify the high frequency behavior of the corresponding 
Laplace transform. 

Interpretation Using the Difference Equation: 

The difference equation for the digital system with n-m zeros at infinity is: 

yk = -( a n-iyk-l + '" + a 0yk-n) + ( b m v k + 
where the altered input v k is defined by the binomial expansion: 


/ _i \ n-m 

v(z) = \l+z ^ u(z) 


where: 


and in general: 


v k ~ u k + u k - 1 f° r n~m = l 
v k ~ u k + 2“jfc_i + Wfc-2 f° r n — m=2 


v*=I 

j=0 


'n-m'' 

v j j 


u k _j , where 


P 

A, 


(p-q)\q\ 


Start with the input u k , from this compute the altered input , and then from the altered input form the 
columns of the data matrix F used in the estimation problem. 


4.3.4 Integrators 

Define the z-transform to be of the form: 


G(z) = 



[b m z m +-+b 0 ] 

1 


[** + 
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The poies at z = +i are integrators, me numerator is n + r tH order but only n parameters need to be 
estimated. Define the restricted set of parameters: 


where for n = 3 and r = 1 : 


and for n = 2 and r = 2 


a n - 1 



O' 

I 


°o 

K 


bo 


R, 


r h 


1 

0 

0 I 

_ 

a 2 


-1 

1 

0 

a 2 

a l 

— 

0 

-1 

1 

a \ 



0 
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0 1 -2 
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Again a pattern emerges; this time the columns of R y contain coefficients of (z - l) r . The easiest way to 

form the product FR is to successively subtract the columns of y. The corresponding Laplace transform 
is: 


r analog 


(j)= 


+ -" + dp 

s r ( 5 ” + C n _]S n— 1 I" Co) 


The altered difference equation is: 

w k = ~{ a n-\ w k-\ + • ’ * + « 0 w k-n ) + {b m U k+m -n-r + — + b O u k-n-r ) 

where: 


W(z) = (l-z ^ y(z) 


4.4 Parameter Transformations 

4.4.1 LLS Solution with Parameter Transformation 
The original error is:. 

e = y- F6 

A transformation can be placed between the data matrix F and the parameter vector 6 : 
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e = y-FU smaller U s ^ jller 0 


It turns out, however, to be more useful to transform a combination of the data matrix F and the output 
vector y: 


e = [y 


-F]UU~ l 


1 

9 


This is the parameter transformation that we will use. To find the parameter vector that minimizes the 
error first define: 


so that: 


b -F](/=bi -fil 


, u~ l 

T 


>' 


e 


kJ 


e = fly 1 -F l 0 l 

and therefore the transformed parameter vector is: 

^=//(WF 1 ) + (Wy 1 ) 

The coefficient fj. is not known apriori, but can be computed from the first row of: 


Resulting in: 


U 


V 


V 

kJ 


6 


// = [l - t/(l, 2 : p)9[ ] / U (1,1) 


and where p is the dimension of the square matrix U. In the case where the transformation matrix U is 
diagonal or lower triangular, which will happen sometimes, then // can be computed apriori to be 
jJ. = 1/1/ (1,1) . Finally, the untransformed parameters are: 


9 = U(2:p,-.) 


4.4.2 Scaling 

Scaling can reduce the dynamic range of polynomial coefficients. Start with: 

^ m +-+fc 0 


G(z) = 


z n + a„_iz" * ■+ h oq 


Scale by replacing z by az : 


_ bnCT-'z” 

z + a n _ \Oc z + • • * + ciq(X 


The scaling is implemented using the diagonal transformation matrix: 

U = diagjl ••• o' 1 a m ~ n 
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Poles and zeros at z,- are transformed to z* \U . Scaling is more important for Laplace transforms then z- 
transforms. A good value to use for scaling is a = co max , where co max is the highest frequency of interest. 

4.4.3 Orthogonal Polynomials 

Better numerical properties for estimation can be achieved by transforming regular polynomials to 
orthogonal polynomials. The transfer function is equivalent to: 

Q, z j _ + 

c mPn(z) + - + c 0 

where the Pi(z)'s are orthogonal polynomials. Chebyshev polynomials are recommended, and the 
transformation matrices are defined in the Mathematical Tools Section. The Chebyshev transformation 
matrix for the case n = m = 3 is: 


U =diag{f/ a U b } , where U a =U b - 

The transformation matrix is lower triangular with fi = 1/ i7 (1,1) = 2 1-n . When estimating Laplace 
transforms scaling should first be done using a = o) max . 

4.4.4 Delta Transformation (the Forward Rectangular Transformation) 

The poles and zeros of a z-transform cluster around z = +1 , causing loss of precision for high order 
systems. The delta transformation is: 


4 0 00 
0 2 00 
-3 0 10 
0 -101 


8 = 


z- 1 
oCT 


where T [seconds] is the sample period. This transformation shifts the poles and zeros so they are centered 
around z = 0 and then scales them. The scaling coefficient a-\ makes the delta transformation the same 
as the forward rectangle approximation of the derivative, and hence the alternative name. 

The delta transformation can be implemented using the matrix U = diag {U a Ui,}, which separately 

transforms the numerator and denominator. To derive the transformation matrix we will first examine first 
and second order polynomials, from which a general pattern is deduced. Reduce the algebraic clutter a bit 
by setting /? = otT , so that the delta transformation becomes 8 = (z -1)//# . The transformed polynomials 
are: 
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Columns i = l,...,m + l of contain coefficients of [(z-1)/ /?] m+1 1 . The transformation matrix is 
computed using the Matlab commands: 

m=5 ; 

beta=2 ; 

Ub=zeros (m+1 ,m+l) ; 

Ub (m+1 ,m+l) =1 ; 

for i»m: -1:1 

Ub(i :m+l, i) *( [Ub (i+1 :m+l , i+1) ; 0] -Ub (i : m+1, i+1) ) /beta; 

end 

The transformation matrix U a is computed similarly with n in place of m. The total transformation matrix 
is lower triangular with // = 1/17(1,1) = cc~ n • 

Scaling: 

Suggested scaling: 

a=l is no scaling. The digital zero at infinity, z = -1 , is transformed to \5\=2/T . This choice 
makes the delta transformation the same as the forward rectangle approximation of a 
derivative. A problem with this choice is the transformed coefficients may have a large 
dynamic range, which is why the freedom of setting a to something other than unity is 
included. 

a = 2IT shifts z = -1 to 1 5 1= 1 . The dynamic range is reduced, and the transformed frequencies 
are less than unity. Keeping 1 6 1< 1 makes this a good first step for the Chebyshev 
transformation. The problem is that over the frequency range of interest it may be the 
case that | S |«: 1 , particularly when T is very small, and therefore . . . 

cc = co max shifts z = -l to | S\=2l{(O max T), where co max < 2/T rad/sec is the largest frequency 
of interest. The transformed frequencies of interest cover more of the range |£|<1 over 
which the Chebyshev polynomials are orthogonal. 

a=\e^ ( ° maxT -\\IT shifts z = e^ C£>maxT to | S |= 1 , and makes even better use of the transformed 
frequency range 1 8 1< 1 . Note that in the limit as T — » 0 it follows that a — » co max . 

The delta transformation is a scaled Laplace transform, where s = aS . This suggests that the transformed 
LLS problem can be used to estimate the coefficients of a Laplace transform. The delta transformation 
just defined is one of several ways to get to the Laplace transform, and not the best way, with the bilinear 
transformation being preferred, and so we generalize the delta transformation and show how it is used to 
convert between analog and digital systems. 

4.5 Digital to Analog Transformations 

The transformation matrix U can be used to convert the estimation problem from z-transforms to Laplace 
transforms. You can estimate the z-transform coefficients and then transform the result, or as shown here 
you can directly compute the coefficients of the Laplace transform. The transformations of interest here 
are: 


Forward Rectangle 

S =— — - 

ctr 

z - 1 + ccST 

Backward Rectangle 

s=— 

1 

zed' 

Z ~\-aST 
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Bilinear 


f _ (2/(oT)Xz-l) 

2+1 


n Urvr\ 

V I ) 

-6+2/(ctT) 


Scaling by or is included in the transformations, where S = as . The LLS problem is used to estimate the 
coefficients of the delta transformation, which has the allegedly good numerical properties, and then the 
Laplace transform is obtained by the final transformation G(s) = G(S/a). The forward rectangle 
transformation has already been covered, and so we start with the next on the list. 


4.5.1 Backward Rectangle 

Derive the transformation U =diag{f/ <3 t/^} as done before by expanding first and second order 
polynomials and then generalizing the result after establishing a pattern. Set S = (z-l)/(/3z) where 
P = aT and then: 




The transformation is similar to the forward rectangle in that the columns of contain coefficients of 
powers of (z-1)/ ft , but in different parts of the column. Build the matrix with the following snippet of 
Matlab code: 


m=5; 
beta=2 ? 

Ub= zeros (m+1 , m+1) ; 

Ub(l,m+1) =1; 
for 

Ub(l:m+2-i,i) = ( [0;Ub(l i+1) ] -Ub (1 :m+2-i, i+1) ) /beta; 
end 


The transformation matrix U is not lower triangular and so the fJi coefficient that is part of the LLS 
solution is not known apriori. There is another difference with the forward rectangular transformation in 
that the polynomials need to be multiplied by a power of 1/z to complete the transformation. The 
resulting delta transform is: 


GW=GU)U, (1 ^, 


(i - a sr m (d„s*‘+- + d< ! ) 

S n + c n _]8 n * + • • • + cq 


and so if there is a relative difference n-m> 0 in the z-transform this results in a set of RHP zeros at 
S = l/a , which acts like a delay. To achieve a relative difference of n-m in the delta transform (and 
hence the Laplace transform) the original z-transform should be restricted to the form: 


G(z) = 



r" +a„_ 1 z" 1 +--- + O 0 
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The choices for the scaling coefficient a are the same as listed for the forward rectangular 
transformation. 


4.5.2 Bilinear Transformation 

The bilinear transformation has the desirable property that the stable regions in the analog and digital 
domains transform into each other. This is not true of the forward and backward rectangular 
transformations, and this is a good reason to use the more complicated bilinear transformation. Set 
s = P(z- l)/(z + l) where P = 2/(aT) and then: 


— (zi/* 1 


z+1 


v^o 


^Z 2 zlj^2^ (z 2 zl) 

(Z+1)2 W (z+1)2 



u » U? 


V pi' 

1 

r ! -i i ^ 


-Ip 1 0 2 

2 p 0 -2 p 

h 

to 

1 

H-k 

V. 

(2 P) 2 

J 2 P 2 P 2 , 



' ' rr 

Ub u b l 



fM 

h 

[ b o J 


The pattern in the transformation matrix is not so obvious, but columns i = l,...,m + l of contain 
coefficients respectively of (z -l) m+1_I (z + 1)' -1 , built up via: 

m=5; 

beta=l; 

Ub=zeros (m+1, m+1) ; 

Ub (m+1 , m+1) =1 ; 
for i =m : - 1 : 1 

Ub (i :m+l, i) * ( [Ub {i+1 :m+l , i+1) ;0] -Ub (i :m+l, i+1) ) *beta; 
for il=i+l:m+l 

Ub(i:m+l,il)=( [Ub (i+1 :m+l, il) ; 0] +Ub (i :m+l, il) ) *beta; 
end 
end 

The resulting delta transform is: 


G(S) - G (z)| z=( 


s n + c n _js n ^ + • • • + d(j 


If there is a relative difference n — m> 0 in the z-transform this results in a set of RHP zeros at 
S = P = 2/(a7’) , which acts like a delay. To achieve a relative difference of n — m in the delta transform 
(and hence the Laplace transform) the original z-transform should be restricted to the form: 

(z + 1)” m [b m z m +--+fy)) 

G(z) = — : 

z + fl n _i Z H H Oq 

The scaling choices listed earlier will work okay, but better is available. The digital zero at infinity, 
z = -1 , maps to S- , and for this reason a = 2/ T is not a good choice. The scaling a = is still 
reasonable, but better is: 


(2/r)(e-^ r -1) 

e j®max T 



®mgxT 


2 


as T->0 
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5, FREQUENCY DOMAIN IDENTIFICATION 

5.1 LLS Estimation of the Laplace Transform 

5.1.1 Problem Statement 

The identification routines up to now have used time series to estimate the transfer function. The time 
series can first be used to compute the frequency response, and then the frequency response used to 
estimate the coefficients of the transfer function. The frequency data is available at a set of N frequencies: 

o>i - frequencies, for i = \,...,N 

- frequency response, for i = 1, .... IV 

Define the transfer function in a general way as: 

G{6, a>) = transfer function 

6 = parameter vector 

The objective is to find the parameter vector that minimiz es {he cost function: 

■'=x>i |£-G(0,<y f )| 2 

i=l 

The problem is in general a nonlinear minimization problem. We will start with linear version of the 
problem. 


5.1.2 LLS Estimation 

The transfer function to be identified is the Laplace transform: 

G(s) = — = 

d(s) s n +a n _ l s n ~ l — \-oq 

The Laplace variable is s = jco . The parameter vector is: 

& T = [ a n - 1 °o b m ho] 

and the cost function to be minimized is: 


The cost function is equivalent to: 


N , 

y=2> / |3d(s)-c(s)| 2 


1=1 


J = e H We 


where: 


e = A0-b , W = diag(w,) 
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and where e H is the complex conjugate transpose (aka the Hermitian) of the error vector. This is a linear 
least square problem with a complex error and a real parameter vector. A general version of this problem 
was solved in Section 4, and the solution is: 


6 = 




5.1.3 Scaling 

The Laplace transform coefficients can have a large dynamic range, as can the frequencies raised to high 
powers. Scaling the Laplace variable reduces the dynamic range. Define: 


where: 


G(s) = H(Z(s)) = 


£ n +c n-\£ n 1 ' ‘ + c 0 


• «*) = — 

®max 

Estimate the coefficients of H(^) using the scaled frequencies %{jco i ) = ja>i / (o max and the same 
frequency response Q . The partial derivatives are: 



The coefficients of G(s) and H(^) are related by: 


*)] 


J max c i 


and a,- = 


5.1.4 Orthogonal Polynomials 

Scaling the polynomial is an improvement, but even with scaling the high order terms become almost 
linearly dependent, and hence high order problem become numerically not well conditioned. It is better 
therefore to estimate a transfer function defined using a linear combination of orthogonal polynomials: 

G(s) = H(£(s)) = K(p(£(s))= /mPm+ " + /o 

Pn +e n- \Pn-V + e O 

Estimate the coefficients of K(p) using the orthogonal polynomials /?(£) evaluated at the scaled 
frequencies £ = slco max . The frequency response does not change, in other words, the objective is still 
to match this frequency response. The partial derivatives are: 

<t>J - P0(6)] [Pmiti) - PO (£)]] 

Any set of orthogonal polynomials will do, but the set usually recommended is the Chebyshev 
polynomials. This set of polynomials does a good (optimal?) job of approximating the frequency 
response. The Chebyshev polynomials are defined by the iteration: 

Po (*) =1 

Pl(x) = x 

Pk (*) = 2 *Pk-\ U) - Pk-i( x ) 
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The series continues: 


p 2 (x)-2x 2 -l 
p 3 (x) = 4x 3 —3x 
Pi, (*) = 8 a: 4 - %x 2 + 1 
/>5 (jc) = 1 6 a: 5 - 20a: 3 + 5 x 
p 6 (x) = 32x 6 -48a: 4 +18a: 2 -1 

Use matrix operations to convert between the polynomial coefficients: 

dm£ + ,,- +^o 

where: 



=r 

± m 

fm 

- d «. 


Jo. 


For m = 3 : 




'4 

0 

0 

O' 

'h 

d 2 


0 

2 

0 

0 

h 

d X 


-3 

0 

1 

0 

h 

do. 


0 

-1 

0 

1 

Jo. 


The transformation matrix is computed from the defining equations using the Matlab commands: 

m=10 ; 

T=zeros {m,m) 

T (m-1 :m) ^eye (2) ; 

for i=m-2:-l:l 

T(i:m,i)=[2*T(i+l:m,i+l) ; 0] -T {i : m, i+2) ; 
end 

5.2 Iterative Solution (SK Iteration) 

The un-weighted cost function used for the linear problem minimizes the frequency response of just the 
numerator. As a result the solution tends to match the frequency response data better at frequencies where 
the numerator is large, which will be at high frequencies. This is not usually where the best match is 
desired, but for many problems, usually low order problems with small errors, the linear solution will 
work just fine. Better, however, is to minimize either the absolute or relative error of the frequency 
response. Either of these objectives can be achieved using a weighted cost function: 

N 

J = X w i \£d(s)-c(s)\ 
i = 1 

where either: 


Wi =\d(a>i)\ 2 to match ^ at frequencies where ^ is large (absolute error) 
w i = |c(ty, )| 2 to match ^ equally across the frequency range (relative error) 
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The weights depend on the estimated transfer function, so they can only be used in iteration. Set the 
weight based on the previous estimate, and then solve the linear problem again to update the solution. Do 
this a fixed number of times or until a stopping condition is reached. This iteration is not strictly speaking 
an optimal solution, but again is often is good enough, and if better is needed this solution is a good 
starting point for the true nonlinear optimal solution. The same iteration scheme works using the 
numerator and denominator of H(£) and K(p) . 

5.3 Nonlinear Frequency Domain Estimation 

The transfer function is: 


C(-) - Gnumi?} _ km 5 ” 1 + "' + fr) 

G den 0 s ) S n + • • • + Oq 


which has the parameter vector: 


o 1 =K-i — «o K 




The objective is to find the parameter vector that minimizes the cost function: 


N 


»=i 

The error is no longer a linear function of the parameters, and hence this is a nonlinear minimization 
problem. The partial derivatives are: 


* G _ r dc£ n 


-l 


dcii 


Ba, 


Gs i for i = 0,...,n - 1 


J den 


3G 


db: G, 


]_^ G num_J_ s i for j = 0 m 


den 


Fill up a matrix with these partials: 


F = 


H 




L^J 


aH 


db t 


1 


J den 


G den( s i)\- 


-G( Sj )( s r 1 - i) (»r - i)] 


The Newton-Raphson update is: 

86 = {FlWF R + FjWFj ) _1 [FlWe R + F?Wej ) 


Setting the weights w, to unity will minimize the absolute error. Setting the weights to w,- =| ^ | 2 will 
minimize the relative error. Start the iteration with the linear solution, or alternatively after several 
iterations of the weighted linear solution. 

The nonlinear solution works similarly with the scaled and orthogonal polynomial versions of the transfer 
function, and just to be bloody obvious, the scaled transfer function is: 

H ,e ) - H man (f) = rf m £ w +- + 4) 

F+C^ 1 ?- 1 - + C 0 
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which has the Darameter vector: 

4 . 

9 T =i c n - 1 •” c 0 d m "• do] 

The cost function is: 


N 


i = 1 


And the vector of partials is: 

A.H _ 1 


»*»<«> 


-*(*>(ir‘ - i) - i)] 


The transfer function with orthogonal polynomials is: 

K(p) 

K den ( P ) Pn + e n-lPn-l " + e 0 

which has the parameter vector: 

^ ~[ e n- 1 •" e 0 fm •" /o] 

The cost function is: 


And the vector of partials is: 


N 


i = 1 


1? l(fi) ■ 1) (p„<fi) - 1)] 

A den 


5.4 Estimating Delay 

The delay can be included in the vector of parameters to be estimated. Change the transfer function to 
include a delay: 


^ num (£) ^-TJ _ g -rs 

(■*) ■r n + * •" °0 


Include the delay parameter in the vector of parameters: 

# T =[cn-\ "• c 0 d n 
The cost function does not change: 


d 0 t] 


N 


i=i 


The new partial derivatives are 

dG 


d£dL _ "I n j 

30j- Gden 


da j 


= G e 

w nwm c 


-r.s 


Gs for z=0,...,rc-l 
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3G 

dbi 


-TS 


&den 


dG num _ g~" _i 
G den 


for i = 0, 


,m 


dG G^m de~* s _ , c 
dr G^ dbi 

Place these partial derivatives in a vector: 

The rest of the solution is the same. The scaling affects the delay, and so we need to show how the scaled 
delay enters into the scaled transfer function: 

H(J=) - bjrurn (j) -r h 4 _ + ‘" + ^0 -z h g 

* Hdenit) + 


where % = sl <w max and t=r h ! co max . The parameter vector is : 



•• c 0 d m ••• d 0 


and the vector of partials: 



*•-£-{-*(** 
M den L V 

■ l) «"*** (#" •• 

‘ 1 <Unum)\ 


Use the same scaled delay when the rest of the transfer function is defined using orthogonal polynomials: 

K(p) - K num(p) c -r h £, = /mPm+’-' + fp -x h £, 

K(ien (p) Pn e n-lPn-l *" e 0 

The parameter vector is: 

& T = [ e n- 1 ••• e 0 fm /o T h] 


And the vector of partials is: 

^=-^—\-K(p n - 1 - 1) e~ T ^{p m - 1 -$iK num ) 1 

K den L J 


5.5 Estimating the z-Transform 

Frequency domain estimation works just as well for z-transforms. Start with the same frequency response 
estimates , available at frequencies tu,- , say for M points, and define the frequency response index to be 
i = 1,...,M . The transfer function to be identified is the z-transform: 

diz) z n +a„_ 1 z n ~ 1 -" + a 0 

The z-transform variable is z = , where A is the sample period. The parameter vector is: 

qT =K-i "• *o b m ••• i> 0 ] 
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For the linear version of the estimation problem use the cost function: 


The solution is: 


where: 


1=1 

0 = ^Re(,4 H W4)] l Re(A H W&) 



5.6 Frequency Domain Estimation Examples 

5.6. 1 Ideal, Low Order Problem 

The F-15 Active example in Section 3.7.1 has the closed loop response: 

6 -21.9(0.993) 

8e c ~ (1.55)(3.39)(6.32) 

The objective is the estimate this Laplace transform using a simulated time response. The following 
calculations are made: 

The closed loop system is simulated using bandpass noise (0.1 to 10 rad/sec, 60 secs with 3 secs 
zero at start and end, no taper, sample period = 50 msec). 

The time series is used to estimate the frequency response (5% taper both sides, no taper, log 
binning with bin ratio = 1.2, min number bins= 3, keep points with rho2 > 0.5). 

The frequency points are used to estimate a Laplace transform (max order = 3, relative difference 
= 2, use points 0 to 50 rad/sec, do SK iterations, do nonlinear minimization). 

The estimated transfer function is: 


6 7.41(-397) 

8 ec ~ [0.896,5.51(131) 

Close, but not right on. The process, complicated as it may be, has systematic errors built into it. To 
exactly match the original model: correct for the FFT end effects when estimating the frequency response, 
so that the FFTs of the delayed input and output are exact, estimate the coefficients of the z-transform, 
and then convert to the Laplace domain using the inverse ZOH transformation. 

Here and throughout this project the systematic errors are not corrected, but they are small, as shown in 
Figure 135a. Three frequency responses are compared: The dark solid lines are the exact frequency 
response using the model, the squares are frequency response estimated from the time series, and the 
light, dashed lines are the frequency response from the estimated transfer function. The phase error above 
10 rad/sec is due to the sampled-data delay, which is in the data, but not the original Laplace transform 
model. 
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Figure 135. Estimated Frequency Responses (F-15 Active Example) 


5.6.2 Ideal, High Order Problem 

Continue the example from Section 3.7.2, using the F-15 Active model extended to include 5* order 
longitudinal dynamics, 2 nd order actuator and sensor models, and some extra delay in the pitch loop. The 
exact closed loop transfer function is: 

6 _ -2.19e5(0.00165)(0.0165)(0.992)[0.707,30][0.866,69.3][0.707,300] 

S ec (0.00134)(0.0166)(1.4)(3.73)[0.203,10.9][0.759,59.8](64.1)[0.706,100][0.707,300] 

Use the same procedure as in the previous example to estimate this transfer function, the only difference 
being the simulation sample period is decreased to 5 msec. The estimated 8* order transfer function is: 

6 _ 9.31(0.916)[0.505,9.32][0.044,14.7](-119) 

8 ec ( 1 ,27)[0.934,6.25] [0.466, 1 0.8] [0.0427, 14.7](23.5) 

An estimated 3 rd order transfer function is: 


6 = 8.48(-126) 

S ec (6.67)[0.922,14.6] 

Bode plots of the frequency responses (using the 8* order estimated transfer function) are compared in 
Figure 135b. Comparing this example to the previous: higher order, same story: good match on the 
frequency responses, and systematic errors prevent exact match of the poles and zeros. 

5.6.3 LOCATS Pitch Response From Fixed Base Simulator Data 

Use the same time series from Section 3.7.3, using the full 105 seconds to estimate the coefficients of the 
selected closed loop transfer functions. There is no truth model to use for comparison. The pitch rate and 
pitch attitude responses from the longitudinal stick are estimated to be: 
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m 



a) Pitch rate 




c) Comparison 

Figure 136. Estimated Frequency Response (LOCATS Run 68, Q/DLON and THE/DLON) 
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Q -95.3(0.245)(1.03)(-16.4) 

DLON “ (0.267)[0.949,3.99][0.625,10.7] 

THE _ -6.99(0.296)(0.846)(-12) 

DLON “ (0.0618)(0.272)(1.75)[0.548,6.74] 

The frequency responses of these transfer functions are compared in Figure 136 with the FFT-derived 
frequency response estimates (5% taper both sides, no taper, log binning with bin ratio = 1.1, min number 
bins= 3, keep points with rho2 > 0.5). Comments: 

• The transfer function frequency responses in parts a) and b) match the data very well. 

• The THE/DLON and integrated Q/DLON frequency responses in part c) are a good 
match from 0.3 to 10 rad/sec, significantly better than the comparison in Section 
5.6.3 based on time domain estimation. 

• The poles of THE/DLON and Q/DLON do not match. 
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6. ESTIMATION USING MARKOV PARAMETERS 

System estimation starts with a time series and ends with system parameters. An intermediate step is to 
compute Markov parameters, and it turns out there are good reasons to do so. The Markov parameters can 
be used to determine the system order, and then used to compute either transfer function parameters or a 
state space realization. 

6.1 What Are They 

The Markov parameters of a digital system are the impulse response. 

Transfer Functions: 

Define the z-transform: 


Gfc)- — ! 

z’'+a n .,z"- l -+a 0 

By long division the z-transform can also be written: 

G(z) = /iQ +}\z *+/ i2Z ^4 — 

The hj 's are the Markov parameters. The Markov parameters are used for convolution: 


yk=1L h k-i u i 

i = 0 

State Space: 

The state space realization of a digital system is: 

**+l = A*k + Bu k 
yk = Cx k + Du k 


The output is: 


The Markov parameters jure: 


ifc-i 

y k = CA k XQ + X CA^Bui +Du k 
i = 0 


h = 


\ D if A =0 
\CA k ~ l B if A >0 


For multivariable systems the Markov parameters are matrices. 


6.2 Determining System Order 

The Markov parameters can be used to determine the system order. The best way to show this is using the 
state space realization. First define some terms. The observability matrix, controllability matrix, and 
Hankel matrix are respectively: 
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o= 

c 

CA 

, P = [b AB - A n_1 s] , M(i,j) = 

' ^ hi +1 ••• hi +j ' 

fy+l b+ 2 ^h+ j+l 


CA n ~\ 


^i+ j j+l ' ' ' ^i+2 j 


The product OP is the Hankel matrix: 



CB CAB ■■ 

• CA n ~ l B 


h h 2 — 

i 

M (X,n-\) = OP - 

CAB CA 2 B .■ 

' CA n B 

= 

••• ^ 

... ^ 
i 


CA n ' x B CA n B • 

■■ CA 2n ~ 2 B_ 


Jhi hji + 1 

a 

i 

i 


The rank of M cannot be more than the rank of the parts O and V , and in fact equals the minimum rank 
of parts O and V , which is the order of the system. Furthermore, if more Markov parameters are added, 
this will not increase the rank, which follows from the Cayley-Hamilton theorem, which states that the 

matrix product A k for k > n is a linear combination of the matrix products less than n. In other words, 
adding higher powers of A to parts O and V will not increase the ranks of O and V , and hence will not 
increase the rank of M. It therefore follows that: 

System order n = Rank[Af (i, j)] if j>n-l 

The condition j>n- 1 is needed because the Hankel matrix has to be at least size n in order to have rank 
n. In practice make the Hankel matrix much larger than the expected system order, and then compute the 
rank to find the actual system order. The best numerical way to determine the rank is by the singular 
value decomposition (SVD). The rank is the number of nonzero singular values. Due to noise in the 
measurements and finite precision in the calculations the small singular values will not be exactly zero, 
and a threshold needs to be established below which the singular values are considered to be zero. 

63 From Markov Parameters to Transfer Functions 

Estimating the Markov parameters from a time series is difficult; we will treat that problem shortly, and 
first show the easy, or at least easier, step of converting the Markov parameters to the parameters of a z- 
transform. The Markov parameters can be computed in terms of the z-transform parameters by equating 
like powers of the polynomial equation: 

(l + fln-jZ -1 + • • • + OQZ ~ n ) (fto + + *2Z -2 +•••) = {b n + Vi* -1 + * * ■ ‘ b oZ~ n ) 

It follows that: 
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i. 1 

'•0 


L 

0 

ho 

h i 


K 


y y 

| 

’ a 0 " 


h n - 2 

ho 

K _ 2 

K-\ 

a l 


h 

ho 

0 

ho h s, 

••• K-\ 

K 

• 

= 

h\ h 2 

... h. 

K + 1 

a n- 1 


hi hj 

• ' h n+ 1 

K+2 

1 


Ki h n +i 

•' h 2n _i 

hln . 


0 


Use the bottom part of the large matrix to compute the a coefficients: 


-sf •* 
1 

•• K ' 

1 

••<§* 
1 

1 

1 

K+i 

hn • 

! 

• C 

a n -\_ 


_ hin . 


And use the top part of the larger matrix to compute the b coefficients: 


V 


'0 • 

• ho~ 

’*o" 

ho. 


.ho ' 

V 

1 


The first several Markov parameters may be zero, which is okay. Say the first nonzero Markov parameter 
is hi , and then the first nonzero b coefficient is . 


When computing the a coefficients the Markov parameter need not start at h \ , and the expression 
generalizes to: 


M(i,n- 1) 


«0 " 


hn+i 



• 

_^n-l J 


hln+i-l. 


In fact we can go further and use a larger Hankel matrix to say: 




°0 

a n - 1 
1 
0 


= 0 


where p>n + 1. The a coefficients can be computed using a basis for the null space of pxp matrix 
M(i,p- 1). We will now show how to do this, the advantage being that the same SVD as used to 
determine the order of the system can be used to create the basis for the null space. Define the SVD as: 
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l) = [l/j U 2 ] 


"Xj o' 


0 0 

1 

1 


where Ej is an nxn diagonal matrix containing the nonzero singular values, and the block matrices have 
compatible dimensions. (The blocks U\=V\ and U 2 = V 2 are equal in the SISO case because in that case 
the Hankel matrix is symmetric. This symmetry does not hold for MIMO systems, and so we keep the 
block names different). The n x p matrix V 2 is an orthonormal basis for the nullspace, and hence there 
exists a pxl vector a such that: 


V 2 a= 



’ ’ 


• 

> 

a n - 1 


1 


0 

> 

_ * _ 



where V 2l is nx p and V 22 is pxp . Use the bottom part of the vector to solve for a , and hence: 


’ °o ' 

=V 21 V 2 j' 

T 

• 

0 

a n -\. 




6.4 The Eigensystem Realization Algorithm 

Hankel matrices can be used to create a state space realization using the Eigensystem Realization 
Algorithm (ERA). Compute the SVD of the Hankel matrix: 


M(l,p-l) = [U 1 U 2 


Xj 0 
0 0 




1/9 

where Xj is nxn and p>n. The terms with Xj are respectively observability and controllability 
matrices, and for this reason it follows that the next Hankel matrix satisfies: 

M(2, p -1) = (t/ 1 X 1 1 /2 )A(x} /2 V 1 r ) 

This equation can be used to compute the A matrix of the state space realization: 

A = (xr 1/2 U 1 7 ’)M(2,p-l)(v 1 Xr 1/2 ) 

Again because they are “ibility” matrices the C matrix is the first row of the matrix C/ 1 X| /2 , and the B 
matrix is the first column of X} /2 Vj^ (or the first set of rows and columns in the MIMO case). Define 
Ei =(l 0 •••) and then: 


B = j\ l2 vf Ef , C = E 1 U 1 X} /2 
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And finally, the D matrix is equal to the first Markov parameter: 

D = h o 


6.5 Estimating the Markov Parameters 

Given the time series: u, and . each defined for i = 0... N — \ and connected by the convolution: 


k 

yk='E h k-i u i 

i=0 

The Markov parameters can be determined from the matrix equation: 
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' ^ ' 


yo 

iq Uq • . : 

hi 


y i 

: •. •. o 

i 



_ U N- 1 •" «1 “0. 

_ h N- 1. 


JN- 1. 


Comments: 

• The matrix is invertible and therefore a solution exists if uq is nonzero. The time 
series should be shifted until m 0 is nonzero. The matrix does not actually have to 
inverted, and the 's can be computed recursively. 

• The Markov parameters are very sensitive to the data. The parameter ho depends 
only on u Q and y 0 . ar) d so on, where in general hj depends only on data up to that 
time. 


• A transfer function or state space system of order n only needs Markov parameters up 
to In , and hence only data up to that time is used. Say the order is not known, and 
Markov parameters are used up to 2 p , where p>n, which means more data is used, 
but still not beyond 2 p . Whatever information is in the data beyond that time is not 
used. Presumably this data could be used to help reduce sensitivity to noise. 

If the data is from a simulation then the simulation must start with zero initial conditions. 

This straightforward method to compute the Markov parameters is theoretically valid but has significant 
practical problems. It is a good starting point for improvement, which we will do shortly, after first 
showing conditions where two different estimation methods give exactly the same transfer function 
parameters. 


6.6 Relationship Between LLS Parameter Estimation and Markov Parameter Estimation 

Given the time series: «; and y f , each defined for i = 0,...,N -1, the objective is to estimate the 
coefficients of the transfer function: 


0 ( 0 = 

z +a n -\Z ••• + % 

Here we show that two different estimation methods give the same answer. 

Method 1: 

The LLS estimation problem using the time series can be used estimate the transfer function parameters: 
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The minimum length time series with N = 2n + 1 is used to estimate the 2n +1 parameters. 
Method 2: 

An alternative method is to fust compute the Markov parameters: 
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( 2 ) 


where again we have restricted attention to the first N = 2n + l parameters, and then from these Markov 
parameters the transfer function coefficients are computed: 


0 

... o 

1 0 ••• 0" 

a n - 1 


fy) 

~bo 


0 : 

• 


i 

: 

0 

: 0 

*0 


i 

—bn— 1 

-ho 

o ■•. 1 

b n 

= 

K 

-K 

~h 

0 ■•. 0 

\ 


K+x 

-b2n-l 

- ~K 

0 ••• 0 0 

.bo . 


_ b 2n 


( 3 ) 


Comparison: 

These two methods should get to the same answer. Equation (2) can be extended to: 
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( 4 ) 


which follows due to the triangular nature of the input matrix. Multiply (3) on the left by the input matrix, 
apply the identities established in (4), and the result is (1). This establishes that both methods give the 
same transfer function parameters. 
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APPENDIX C - WAVELET-EASED ANALYISIS OF ROLL RATCHET USING A 

FLIGHT TEST DATABASE 
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1. OVERVIEW 


Degraded lateral axis handling qualities have at times resulted in sustained high frequency, small 
amplitude pilot- vehicle system oscillations or roll ratcheting. The degraded handling qualities can result 
from a combination of high roll damping, high levels of roll control sensitivity, and poor feel system 
dynamics. In some cases the roll ratchet phenomenon has been considered more of a nuisance that 
primarily affects ride quality, while in the more severe cases it significantly impacts aircraft handling 
qualities. Past ground based simulation research has indicated a peaking of the human pilot 
neuromuscular mode around the ratchet frequency. This link between the dynamics of the human pilot 
and the roll ratchet phenomenon was further explored using the flight research database from a lateral 
handlin g qualities study conducted with the USAF variable stability NT-33A. In this analysis Fast 
Fourier Transform techniques (FFT) were used to compute pilot and pilot-vehicle system describing 
functions. Strong evidence was generated to support the theory that the pilot neuromuscular mode 
couples with the feel system dynamics to produce an effective limb-manipulator mode. However, the 
smoothing of the frequency domain data over a given time window that results from the FFT analysis 
may have obscured the pilot- vehicle dynamic coupling that was changing over time. In this appendix the 
WERA system identification technique is used to reevaluate a subset of the same flight test database and 
to identify key pilot parameters that vary in time. These new results appear to indicate that: a lightly- 
damped mode in the open-loop system is introduced by the human pilot at frequencies higher than the 
task bandwidth; a direct correspondence exists between the peak amplitude of the lightly-damped mode 
and the occurrence of roll ratchet; and the wavelet-based identification technique is a powerful tool for 
assessing pilot-vehicle system performance over time intervals that were previously not feasible with 
FFT-based analysis. 


2. INTRODUCTION 


2.1 Feel Systems and Handling Qualities 

Aircraft cockpit controls are either force or position sensing. As shown in Figure 137a the feel system is 
in series for position sensing. Position sensing does not include the feel system dynamics, while 
measurements ma de in terms of force do include these dynamics. For the force sensing feel system 
shown in Figure 137b the feel system dynamics are in parallel. Thus neither force or position 
measurements include the feel system dynamics, since they are “downstream” of this point. Although 
new aircraft continue to be designed with both types of controls, the force sensing feel system generates 
less lag during closed-loop piloted control (Ref. 48). Examples of force sensing cockpit feel systems 
include the side stick controllers found on the F-16 and F/A-22 fighters, while position sensing examples 
include the center sticks found on the F/A-18 Hornet and Super Hornet fighters and the C-17 military 
transport as well as the center control yolk found on the Boeing 777 commercial transport. 



a) Position Sensing: Feet System b) Force Sensing: Feel System 

is In Series tstiflaratef 


Figure 137. Mechanization of Feel Systems 
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Within the handling equalities comiiiumty 3 debate continues as to the importance of cockpit feel systems 
in a pilot’s assessments of aircraft handling qualities. As detailed in Ref. 49 much of the debate centers 
on how to best account for the effect of the feel system dynamics, if any, when applying handling 
qualities criteria. Although it has generally become accepted practice to include the lags associated with 
control surface actuators when modeling aircraft dynamics for handling qualities assessments, no similar 
agreement has been found regarding the feel system. By reviewing the existing flight test databases 
involving the evaluation of cockpit feel systems, it is concluded in Ref. 49 that the feel system dynamics 
do indeed impact handling qualities. Unfortunately no comprehensive flight test database yet exists to 
effectively set requirements for the many types of feel systems. 


2.2 Limb-Manipulator Dynamics 

In Ref. 48 human neuromuscular actuation is described, albeit in what the reference calls a greatly 
oversimplified manner, as a two loop system. The inner loop involves short pathways from the Golgi and 
muscle spindle receptors directly to the spinal level and back again to the musculature. The time lags 
associated with information flow are low because of these short neural pathways. Thus the effective 
bandwidth of this loop that is primarily sensitive to forces can be quite high. The outer loop features joint 
and other receptors (e.g., peripheral vision) as the major feedback elements. Here the pathways and 
associated delays are longer and thus result in a lower outer loop bandwidth. With a force sensing stick 
there is little or no joint movement, so the higher bandwidth inner loop should dominate. With a position 
sensing stick, on the other hand, the joint receptors are key elements, so the lower bandwidth outer loop 
should dominate. The higher bandwidth closure achieved with a force sensing feel system thus produces 
less lag. 

There are several schools of thought regarding whether or not the feel system lag is altered by pilot loop 
closures around the stick itself. As outlined in Ref. 49 and detailed in Ref. 50, strong evidence now exists 
through analysis of a flight test database that the pilot couples with the feel system dynamics to form a 
combined limb-manipulator second order mode. The analysis techniques employed in Ref. 50 included 
extensive use of Fast Fourier Transform techniques (FFT) to compute pilot and pilot-vehicle system 
describing functions. The describing functions for runs in which roll ratchet was noted by the pilots 
featured significantly greater peaking at the limb-manipulator mode frequency, when compared with runs 
where no ratchet was noted or observed. The describing function assumes time-stationary pilot dynamics, 
and is a measurement of the mean or average pilot behavior for the analyzed run time. In Ref. 51 roll 
ratchet is described as a time- varying, non-stationary phenomenon that would be expected to be related to 
pilot gain and compensation variations throughout the ran. It is thus the objective of this appendix to 
reevaluate a subset of the flight data analyzed in Ref. 50 using wavelet-based techniques from which the 
time-varying nature of key pilot-vehicle system parameters, including the limb-manipulator mode, can be 
examined. 


3. PILOT-VEHICLE SYSTEM IDENTIFICATION USING WAVELETS 
3.1 Discrete Wavelet Transforms 

A technique for extracting the impulse response characteristics of a linear, time-varying system is 
described in Section 5 of this report. It is shown that the discrete wavelet transform (DWT) can be used 
in conjunction with state-space methods to estimate the impulse response function of a system over short 
intervals of time. The order of the system is assumed, an estimate of the free response is subtracted from 
the observed total response, and the residual forced response is used in the convolution integral to 
compute the impulse response using wavelet analysis. The Fourier transform of the impulse response is 
then computed to produce a bode plot of the observed system, and a least-squares fit of the model to the 
observed bode plot (by iterating on the model poles and zeros) is performed using a non-linear regression 
method. The assumed model for describing the pilot in this paper is. 
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&(£) = K (jjj) 

<?(s) p (j 2 + 2^ + c; b 2 ) 

where </> e is the roll error signal, <5 is the pilot stick position, K p is the root-locus gain, z is the lead (zero), r e 
is the effective pure time delay of the pilot, and fit and £ are the natural frequency and damping of the 
pilot neuromuscular mode. 

For identification precision it is necessaiy to shift one of the two signals (</> e or 8) in time by the amount of 
pure time delay introduced by the pilot, r e . Figure 138 depicts the method used for computing t e , where 
both signals are filtered, and the filtered error signal is fed through the assumed pilot model (without t e ). 
The resulting output is then scaled to be of similar magnitude with the filtered stick output of the pilot 
Using a given time window (e.g., 3.7 seconds for the analysis presented in this paper) the sum of the 
squared differences between the two signals is computed. The stick signal is then shifted in time (the 
error signal remains fixed) and the computation repeated. The time delay estimate r e is the shift 
corresponding to the minim um squared difference summation. Figure 139 compares the estimated r< to a 
simulated time delay that varies sinusoidally in time. 


Input to 




Figure 138. Time Delay Computation Method 
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Figure 139. Least Squares Estimation of Simulated Sinusoidal Time Delay 
32 Time Domain Wavelet-Based System Identification 

As a demonstration of the identification techniques described, a Matlab simulation was exercised using a 
sum-of-sines commanded roll signal and aircraft lateral dynamics closely corresponding to those flown in 
the Ref. 51 flight research program. A step decrease in pilot damping from 0.25 to 0.05 occurred at 5 
seconds, followed by a step increase back to 0.25 at 15 seconds. Figure 140a, b, and c show that all the 
pilot parameter estimates closely tracked the actual values in time, so that the crossover frequency (&t), 
phase margin, and gain margin were generally well-estimated. In Figure 140d the simulated stick output 
is compared with the peak magnitude of the limb-manipulator mode, and it is seen that while the 
estimated limb-manipulator peak lags the actual value, it is essentially synchronous in rise and fall with 
the onset and departure of roll ratchet. Numerous simulations confirmed that roll ratchet is present if the 
limb-manipulator peak approaches or exceeds 0 dB. 

In Figure 141 the bode plots corresponding to the pilot- vehicle system open-loop transfer function 
estimates are superimposed, showing the spread of magnitude and phase over the full run-time. The limb- 
manipulator peaking that occurs in the vicinity of 10 rad/sec is depicted over the course of time in the 
right panel of Figure 141, where the region of 10 rad/s is magnified. Note in Figure 140d that from 7 to 
17 seconds the limb-manipulator peak rises above the 0 dB plane, corresponding to the occurrence of 
ratchet 

4. FLIGHT TEST DATA OVERVIEW 
4.1 Flight Research Program Description 

Under contract to the U.S. Air Force and supported by NASA Dryden Flight Research Center, an in-flight 
lateral handling qualities research program was conducted by Calspan Corporation (now Veridian) in 
1987. As documented in Ref. 51 the program used the variable stability NT-33A aircraft to investigate 
lateral handling qualities issues including stick feel system dynamics, gradient, and sensing type (i.e., 
position or force) in combination with roll mode time constant variations. The evaluation tasks were 
sum-of-sines (SOS) and discrete head-up display (HUD) tracking, air-to-air tracking, and power approach 
and landing. Following the initial work of Ref. 52, one specific objective of the program was to further 
investigate the effects of time delays and feel system delays on handling qualities. In addition to the 
published results of Ref. 51, an independent assessment of the resulting flight test database was carried 
out by Systems Technology, Inc. (STI) and reported in Ref. 50. This work featured the describing 
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Figure 141. Pilot-Vehicle System Open-Loop Bode Plot and Corresponding Limb-Manipulator Peak 

Magnitude 


4.2 Sum-of-Sines Tracking Task 

The describing function analysis undertaken in the Ref. 50 independent review of the Ref. 51 flight test 
data focused on the SOS tracking task. A block diagram description of this closed-loop, compensatory 
tracking task is shown in Figure 142. In the figure the pilot is represented by the Y p block, while the 
aircraft or controlled element is represented by the Y c block. The objective of the task is for the pilot to 
minimize the error (<p e = <j> c - <fi) displayed on the HUD within defined tolerances. Data from this type of 
tracking task where the input is known can be used to identify the dynamics of the pilot (Y p ), controlled 
element (Y c ), open-loop system (Y p Y c ), and closed-loop system [Y P Y C l{\+Y p Y c )]. 

Controlled 
Pitot .\/:Bement 

6 


DAS - Stick PosWon fin.) 

FAS - Stick Force (lbs) 

P - Roll Rate (deg/fe) 

PHIC - Roll Command <f> c (deg) 

PHIE - Roll Tracking Euor 4> 0 (deg) 

PHI — Roll Attitude ^ (deg) 

Figure 142. HUD Sum-of-Sines Tracking Task 

An example SOS bank angle command {(p c ) signal is shown in Figure 143, and the corresponding power 
spectra density plot is given in Figure 144. The SOS signal is made up of 13 frequencies that are 
essentially evenly spaced on the log-frequency axis of Figure 144. In general, far fewer frequencies are 
required to ensure that the task appears random to the pilot. The range of frequencies found in the signal 
(i.e., approximately 0.4 to 22 rad/sec) adequately extends from the region of piloted control beyond limb- 
manipulator mode interaction. Note that the four lowest frequencies all have essentially the same input 
power. The power then drops off at an approximately -20 dB per decade slope, which prevents the higher 
frequencies from dominating the task. 



4> c 
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Figure 143. Example Sum-of-Sines Bank Angle Command (£) 
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Figure 144. Power Spectra Density for Example Sum-of-Sines Bank Angle Command (^) 


43 Selected Runs 


Configurations flown with the variable stability NT-33A featured both force and position sensing feel 
systems with fast, slow, and degraded dynamics as defined by the feel system natural frequency (26, 13, 
and 8 rad/sec, respectively). The aircraft lateral dynamics featured roll mode time constants of 0.15 sec 
(highest roll damping), 0.25 sec, and 0.40 sec (lowest roll damping). Some configurations also included 
added command path time delays of either 55 or 1 10 msec. 


Four SOS tracking task runs from the Ref. 51 flight research database were selected for the WERA-based 
analysis described in this appendix. All four runs were flown by the same pilot with the same roll control 
sensitivity (18 deg/sec/lbs). As identified in Table 37 the first selected case (Run 4069.1) featured a slow 
feel system (13 rad/sec) and the highest roll mode time constant. This configuration received a Level 1 
handling qualities rating for the tracking task evaluation with no roll ratchet or PIO tendencies. The 
remaining three configurations listed in the table all had significant handling qualities deficiencies. The 
Run 4069.4 configuration had the degraded feel system combined with the highest roll damping, and 
resulted in continuous roll ratchet and a Level 3 handling qualities assessment. Next, the Run 4161.3 
configuration had the fast feel system, a 55 msec command path time delay, and medium roll damping. 
This ran featured intermittent roll ratchet and a Level 3 handling qualities rating. Finally, Rim 4176.1 
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featured the same configuration as 4161.3 except with no command path time delay. This run resulted in 
Level 3 handling qualities with continuous lower frequency ratchet. 


Table 37. System Characteristics and Flight Results for Selected Runs 



Command Path Dynamics 

Roll Mode 

Flight Results 

Run No. 

cafs (rad/sec) 

r(msec) 

TV (sec) 

Description 

HQR 

4069.1 

13 

None 

0.40 

No sustained ratchet 

2 

4069.4 

8 

None 

0.15 

Continuous ratchet 

8 

4161.3 

26 

55 

0.25 

Intermittent ratchet 

7 

4176.1 

26 

None 

0.25 

Lower frequency ratchet 

7 


Stick force time histories for the four runs identified in Table 37 are shown in Figure 145. In general, 
ratchet can essentially be identified by simple inspection of the time histories. For example, no sustained 
ratchet is evident in the Level 1 configuration stick response of Figure 145a, however, the other 
configurations clearly display the sustained high frequency oscillations. Note also that the intermittent 
nature of the ratchet in Figure 145c and the lower frequency ratchet in Figure 145d. Time histories 
showing the set of signals identified in Figure 142 is presented in Figure 146 for the intermittent ratchet 
example (Run 4161.3). 



a. Run 4069.1, No Sustained Ratchet 
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c. Run 4161.3, Intermittent Ratchet 
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6. Run 4069.4, Continuous Ratchet 




cl. Run 4176.1, Lower Frequency Ratchet 


Figure 145. Stick Force Time Histories for Selected Analysis Runs 
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5. WERA ANALYSIS OF TRACKING TASK FLIGHT TEST DATA 

The wavelet identification method was initially applied to flight data from the intermittent ratchet case 
(4161.3). Pilot parameters were estimated using roll attitude error {<p e ) and pilot stick output ($. Figure 
147a shows the reconstructed pilot stick output that is generated using the pilot parameter estimates and 
the roll attitude error - both time series share very similar shapes and ratcheting. Figure 147b shows the 
limb-manipulator frequency roughly corresponding to the ratchet frequency of 12.5 rad/s. In Figure 147b 
pilot damping is seen to inversely affect ratchet - although this is not as good an indicator of ratchet as the 
limb-manipulator peak amplitude, shown later in Figure 148a. 

Time variations in gain margin, phase margin, pilot time delay, and crossover frequency (Figure 147c and 
d) are much larger than those observed in the simulated case, indicating that time variations in these 
parameters are actually occurring. In Figure 148 there is excellent agreement between ratchet and limb- 
manipulator peak as it increases toward 0 dB. From the data, a threshold appears to exist at 
approximately -2dB, above which ratchet occurs. Even for the case where the pilot did not report ratchet 
(Figure 148d), the pilot stick time history shows short intervals of ratchet-like behavior during which the 
estimated limb-manipulator peak approached 0 dB. 
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Figure 148. Stick Position (Flight Data) and Estimated Limb-Manipulator Gain Margin Time Histories 
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Because the tracking task generally required actions at frequencies (i.e., crossover) well below the limb- 
manipulator peaking, the secondary rise in open-loop magnitude at the limb-manipulator frequency can in 
most cases be viewed as a “nuisance” mode where higher-frequency/low amplitude ringing rides on top 
of the primary tracking stick signal. This can, however, significantly impact perceived handling qualities 
as reflected in the Level 3 pilot ratings listed in Table 37. 

6. CONCLUSIONS 

In previous analysis of a lateral handling qualities flight research database strong evidence was generated 
to support the theory that the pilot neuromuscular mode couples with the feel system dynamics to produce 
an effective limb-manipulator mode, the frequency of which corresponded to observed roll ratchet 
frequencies. A subset of this same database was analyzed using wavelet-based techniques from which the 
time-varying nature of key pilot-vehicle system parameters, including the limb-manipulator mode, could 
be examined. The results of this analysis appear to indicate that a lightly-damped mode in the open-loop 
system is introduced by the human pilot at frequencies higher than the task bandwidth and this 
corresponds to the previously identified limb-manipulator mode. A direct relationship was found to exist 
between the peak amplitude of the limb-manipulator mode and the occurrence of roll ratchet. From the 
data, a threshold appears to be at approximately -2dB, above which ratchet occurs. Even for the case 
where the pilot did not report ratchet, the pilot stick time history shows short intervals of ratchet-like 
behavior during which the estimated limb-manipulator peak approached 0 dB. Finally, the WERA 
identification technique was found to be a powerful tool for assessing pilot-vehicle system performance 
over time intervals that were previously not feasible with FFT-based analysis. 
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FOREWORD 
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1. INTRODUCTION 


This three volume report documents the results of a Phase II Small Business Innovation Research (SBIR) 
contract to develop an on-line means to predict aircraft loss of control using wavelets. Systems 
Technology, Inc. (STI) conducted the work for NASA Dryden Flight Research Center at Edwards, CA. 
The overall objective of this proposed program was to apply wavelet technology in the form of a Loss of 
Control Analysis Tool Set or LOCATS as a means of predicting loss of control for the broad range of 
refractory automatic and manual control system problems. These control problems are those that escape 
detection by typical design criteria and methodologies, surface under unusual or rare circumstances, and 
threaten flight safety. Specific Phase II technical objectives were as follows: 

• Extend the capabilities of the LOCATS to include improved wavelet formulations for 
real-time applications with validity measures; 

• Identify time varying pilot- vehicle system characteristics that can be an indicator of 
impending loss of control; 

• Identify, develop and validate wavelet-based time varying metrics to predict loss of 
control of automatic and manual flight control systems and to monitor overall flight 
control system health; 

• Develop software and/or hardware solutions for the implementation of the real-time 
LOCATS; 

• Provide a graphical user interface, real-time graphics displays, and networking 
capabilities for the prototype real-time LOCATS; and 

• Evaluate the prototype real-time LOCATS in a piloted simulation that features flight 
control system software and hardware representative of current state-of-the-art 
aircraft. 

The evaluation of the prototype LOCATS was conducted using the flight control system hardware-in-the- 
loop simulator facility of BAE SYSTEMS Platform Solutions Sector (here after referred to as BAE 
SYSTEMS) of Johnson City, NY. 

Volume I of this report begins with an overview of issues involving aircraft loss of control. This is 
followed by a description of the LOCATS software, detailed development of the wavelet-based loss of 
control detection techniques, and a discussion of the results from the LOCATS piloted simulation 
evaluation. Supporting material is provided in the appendices. Volume II of this report provides the 
LOCATS piloted simulation test plan and detailed descriptions of the simulation checkout and formal 
evaluation. Finally, Volume m of this report contains the LOCATS User’s Guide. 
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2. LOCATS SIMULATION TEST PLAN 


2.1 Background 

2.1.1 Simulation Objectives 

The overall objective of this piloted simulation is to evaluate the capabilities of the STI wavelet-based 
LOCATS to detect impending loss of control. The specific objectives are as follows: 

• Install the LOCATS software on a personal computer provided by BAE SYSTEMS 
that is connected via a network to the simulator facility computers; 

• Receive selected simulator data in real time over the network while the pilot performs 
various closed-loop tasks; 

• Perform assessments of the pilot-vehicle system and flight control system and present 
results in real time; 

• Determine which wavelet-based algorithms or combination thereof provide the best 
results for a given loss of control scenario; 

• Assess how quickly degrading conditions or impending loss of control can be 
detected; and 

• Evaluate the utility of the selected metrics and corresponding real-time displays. 

2.1.2 BAE S Y STEMS Simulator Facility 

BAE SYSTEMS maintains and operates a real-time simulation facility of a fly-by-wire military transport 
aircraft that features a fixed-based engineering development cockpit. Figure 1, equipped with a visual 
display system and a control feel system. 



Figure 1. Fixed Based Cockpit 

The cockpit interfaces with a real-time simulation host computer that is capable of running real-time 
models of the aircraft, environment, engine, actuator and sensor models as well as performing high-speed 
data acquisition. Both the cockpit and the host computer are integrated with the actual Flight Control 
Computer hardware located in a Hot Bench. Figure 2 shows a representative arrangement for the 
simulation facility. The basic development cockpit is fitted with functional cockpit panels and stick 
force/position transducers for operation of the flight control system. Other essential pilot vehicle 
interfaces such as the throttle quadrant, head-up display (HUD), and engine instrumentation are also 
provided to allow the pilot to perform testing effectively in a suitable and representative environment. 
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Figure 2. Simulation Facility Hardware Architecture 

As shown in Figure 3 the real-time simulation facility utilizes a Concurrent computer as its host 
computer. The simulator cockpit interfaces with the real-time simulation host processor via an I/O 
subsystem. The I/O subsystem provides the data conditioning and conversion of the necessary analog and 
discrete signals required to allow the cockpit controls, displays, and indicators to interface properly with 
the simulation models executed in the simulation host computer. 



Figure 3. Simulation Host Computer 

The cockpit contains a visual display driven by a separate display processor that interfaces with the host 
computer. The visual display provides the pilot/engineer with an out-the-window visual reference that is 
essential in providing attitude, distance, and rate information required to allow accurate pilot loop closure. 
The visual display provides information to the pilot by means of a 2-dimensional drawing of the HUD 
generated by the visual computer and directly superimposed on the out-the-window view. Figure 4 shows 
the Silicon Graphics Octane computer used for visual display processing for the cockpit and for a separate 
monitoring station. 
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Figure 4. Visual Display Computer and Monitoring Station 


The real-time simulation can be configured to run in two basic modes. The first, Software-in-the-Loop 
(SIL), runs with a simulated flight control model implemented in FORTRAN that runs on the host 
computer. The second, Hardware-in-the-Loop (HIL), utilizes the Hot Bench mentioned earlier to 
integrate actual Quad Redundant Flight Control Computers into the simulation environment. The Hot 
Bench, called the Subsystem Evaluation Station (SES), provides an excellent method for testing of the 
entire system, with a pilot-in-the-loop, with actual and simulated sensor and actuator signals feeding 
actual flight control computers. Figure Sdepicts the SES station utilized during HIL simulations. 



Figure 5. System Evaluation Station 


2.2 Flight conditions and aircraft configurations 

2.2.1 Flight Conditions 

The piloted evaluations will be conducted in both up-and-away and terminal flight conditions. Specific 
flight condition variations are identified in Table 1. Each evaluation will begin with the aircraft trimmed. 
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Table 1. Flight Conditions for the Piloted Simulation 



ID 

Description 

Altitude 
(1000 ft) 

Airspeed 

(KCAS) 

Turbulence 

Crosswinds 

(knots) 

1 

C 

Cruise 

20 

270 

None 

n/a 

2 

CM 

Cruise with Turbulence 

20 

270 

Moderate 

n/a 

3 

CH 

High Altitude Cruise 

40 

200 

None 

n/a 

4 

mm 

Approach 

0.2 

130 

n/a 

None 

5 

AX 

Approach with Crosswind 

0.2 

130 

n/a 

20, R to L 

6 

SA 

Steep Approach 

0.3 

130 

n/a 

None 

7 

SAX 

Steep Approach with Crosswind 

0.3 

130 

n/a 

20, R to L 


2.2.2 Configuration Descriptions 

As mentioned above the piloted evaluations will be conducted in both up-and-away and terminal flight 
conditions. Specific aircraft configurations variations are identified in Table 2. Once again, each 
evaluation will begin with the aircraft trimmed. 


Table 2. Aircraft Configurations for the Piloted Simulation 


No. 

ID 

Description 

Gross Weight 
(10001b) 

CG 

(% chord) 

Flaps 

(deg) 

Gear 

1 

CHF 

Cruise/Heavy/FwdCG 

580 

0.3 

Retracted 

Up 

2 

CHA 

Cruise/Heavy/AftCG 

580 

0.4 

Retracted 

Up 

3 

CLF 

Cruise/Light/FwdCG 

300 

0.27 

Retracted 

Up 

4 

CLA 

Cruise/Light/AftCG 

300 

0.42 

Retracted 

Up 

5 

ALF 

Approach/Light/FwdCG 

300 

0.27 

27.4 

Down 

6 

ALA 

Approach/Light/AftCG 

300 

0.42 

27.4 

Down 

7 

SALF 

Steep Approach/Light/FwdCG 

300 

0.27 

37 

Down 

8 

SALA 

Steep Approach/Light/AftCG 

300 

0.42 

37 

Down 

9 

SAHF 

Steep Approach/Heavy/FwdCG 

400 

0.3 

17.1 

Down 

10 

SAHA 

Steep Approach/Heavy/AftCG 

400 

0.4 

mam 

Down 


2.3 Piloted Evaluation Tasks 

2.3.1 Overview 

The piloted evaluation tasks included herein were defined as part of an Air Force program conducted by 
STI to develop a catalog of fixed-wing aircraft handling qualities demonstration maneuvers (Ref. 1). 
Thus the maneuver descriptions feature the format established in the aforementioned program. This 
format includes a list of objectives, the task description, and the desired and adequate performance 
requirements. The objectives identify specific handling qualities characteristics that the maneuver is 
designed to expose. The task descriptions provide step by step guidance to the pilot for carrying out the 
maneuver. These descriptions are written as if they are to be used by the pilot as a flight card. The 
performance requirements are written to correspond with direct use of the Cooper-Harper handling 
qualities rating scale (Figure 6) and if applicable the pilot-induced oscillation tendency scale (Figure 7). 
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Figure 6. Cooper-Harper Handling Qualities Rating Scale (Ref. 2) 
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Performance 
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Divergent? 
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or Tight Control 


UndaairaMa motions «aatty induced when plot inHMee abrupt 
manatwera or attempt* light oontroL Tbaee mottona can be 
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or tempts fght control. Plot must reduce pain or a bandon teak 
torecover 
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manatwars or attempts tight control, Plot must open loop by 
r e l aa ai riB or teaadng ate* 


I DWubanee or norm* plot cored may cause dkergsht oscMadon. 
iFBctmuatopan oonfrgf loop by rateaaing or freezing tie atiok 


Figure 7. Pilot-Induced Oscillation Rating Scale (Refs. 3 and 4) 

The demonstration maneuvers selected for this program were as follows: 

• Pitch and Roll Sum-of-Sines Tracking (SOS); 
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• Pitch slid Roll Discrete Trac kin g (DT)j 

• Pitch Attitude Capture and Hold (PACH); 

• Bank Angle Capture and Hold (BACH); 

• Flightpath Capture and Hold (FPCH); 

• Altitude Rate Capture and Hold (ARCH); 

• Precision Offset Landing (POL); 

• STOL Precision Offset Landing (STOL/POL); and 

• Precision ILS Capture and Track (ILS). 

Note that both up-and-away and terminal flight operations are featured. Background material and task 
descriptions from Ref. 1 are provided below for each maneuver. Note that because this program is not a 
handling qualities evaluation per se, some adjustments to the maneuver descriptions and performance 
requirements were later made to better meet the objectives of this piloted simulation. 

2.3.2 Pitch and Roll Sum-of-Sines Tracking (SOS) 

2.3.2. 1 Background 

Tracking a computer-generated command signal produces a highly repeatable, precise task from which 
measures of pilot performance can be obtained. While such measures should never be interpreted as a 
direct indicator of handling qualities, they are one sure way to monitor pilot workload and confirm that 
workload is as desired. Use of similar tracking tasks has for decades provided a source of information on 
pilot/vehicle closed-loop dynamics. The maneuver proposed here is based on this experience, but with 
some of the nuances of past applications removed for simplicity. 

Two of the most common types of tracking commands are the Veridian (formerly Calspsan Corporation) 
step-and-ramp (discrete tracking) and a sum-of-sinewaves. The discrete task was found in two USAF 
TPS projects (Refs. 5 and 6) to be better at producing repeatable, consistent pilot ratings. The sum-of- 
sines (SOS) task, however, is considered a more robust form of command for extracting pilot/vehicle 
information as long as the effective bandwidth of the forcing function is sufficiently high (Ref. 7). Also, 
the pilots must understand that this maneuver is a surrogate for an air-to-air tracking task and that it 
should not be viewed as a video game. 

Ideally, the display for this maneuver will be a head-up display (HUD) with an appropriate command bar 
and fixed pippers for desired and adequate performance. Realistically, however, such a display may be 
restricted only to experimental and research aircraft, at least for the near future, so the maneuver should 
not be limited only to HUDs. The display device may be the command bars on a flight director, the 
glideslope and localizer bars on a horizontal situation indicator, etc. If a HUD is not used, the definitions 
of command scaling (units of actual error per displayed error) and performance limits become critical. In 
addition, for any display, the dynamics of the display drivers become important. Total throughput delay 
should at least be known, even if nothing can be done about it. 

It is important to recognize that the signal displayed to the pilot is tracking error, not the command. For 
example, in pitch 6 display = 6 C - 6, where 6 C is the command from the sum of sinewaves and 6 is airplane 
attitude. This makes the task compensatory in nature: the pilot compensates for displayed changes in 
attitude rather than pursuing an attitude command. Ideally, the pilot is not given any information on 
actual attitude, including out-the-window, if the cockpit orientation allows. If a HUD is used, blackout 
material behind the HUD and an instrument training hood will usually suffice. 

The form of the SOS command is as follows: 
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^ = E A »sin(^ + ^) 

1=1 

A recommended forcing function is defined below for pitch control and for roll control. These are not the 
only acceptable forcing functions, and the user may wish to devise other sets of co mman ds to emphasize 
different frequencies of control. Based on considerable experience with SOS tracking, certain guidelines 
can be specified in devising the forcing function: 

• Several discrete frequencies should be used. At least six sinewave signals should 
provide a broad range of commands. More are better but are not necessary. 

• For pitch and roll, the frequencies of the sinewaves (#|) should vary from around 0.2 
to 0.4 rad/sec up to 8 to 10 rad/sec. Magnitude of the sinewaves (A,) should be 
reduced above about 1.5 to 2 rad/sec, as needed to provide a bandwidth of 1.5 rad/sec 
or so. 

• For other axes, such as heading, flightpath, load factor, or airspeed, the pilot’s 
bandwidth of control is typically lower than for pitch or roll. The upper frequency 
should be reduced accordingly, as should the effective bandwidth of die SOS signal. 

(If the pilot is given a direct control of one of these axes, or if there is a requirement 
for high-frequency control, the guidance for pitch and roll should be followed.) 

• Concentrate the sinewaves below the bandwidth frequency of the total signal. If only 
six discrete frequencies are used, one or two should be dedicated to higher 
frequencies (but with reduced magnitudes as noted above). This provides a high- 
frequency “gust-like” component that helps make the command look more random to 
the pilot. If more than six sinewaves are used more high-frequency components can 
be included. 

• Overall root mean square (RMS) magnitudes should be around 2.5° attitude in pitch 
and 25° in roll (Ref. 8) for simulated up-and-away operations. These numbers may 
need to be reduced somewhat if the tracking is to be performed in landing 
configuration, or at high speed if the resulting load factor is excessive. 

• Start some of the sinewaves with negative amplitudes or with nonzero initial phase 
angles), so the initial displayed error is not always large and in the positive direction. 

If randomness is important (which is the case if one pilot is to fly the task many 
times, the signal can be made to look random by adding an arbitrary phase shift ($) 
to some of the sinewaves and varying this.phase shift from ran to ran. 

• The entire run should be around one minute to 90 seconds in length. Anything longer 
may be fatiguing to the pilot; a shorter ran may not provide sufficient exposure to the 
airplane, even if the task is immediately repeated. 

• If pilot/vehicle data are to be extracted, care should be taken to assure that the entire 
ran of scored data (data to be analyzed) includes at least one full cycle of each 
sinewave and that there is an integer number of all sinewaves. In addition, a warm- 
up period at the start should be added. This period is several seconds of non-scoring 
time during which the command is ramped in, allowing the pilot to get into the 
control loop before formal data taking begins. 

More information about the design of the sum-of-sines forcing function, including example numbers, can 
be obtained from Refs. 7 and 8. Many more references on this topic are available. 
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Recommended forcing functions are given in Table 3. The pitch numbers are from Ref. 6, while the roll 
values are from Ref. 7. Figure 8 shows a time history of the pitch signal for reference. The task time for 
both command sets is 74.25 seconds, consisting of the following: 10 seconds of warm-up (non-scored 
time); 63 seconds of tracking for scoring; 1.25 seconds of cool-down (non-scored time). All sinewaves 
complete an integer number of cycles in 63 seconds, as listed in the table. Sinewave frequency, (in 
rad/sec), is computed from the scoring time, t s , and number of cycles of each sinewave, N h as follows: 

2nN i 

— L 


Table 3. Recommended SOS Command Signals for Pitch and Roll 


Sine- 

Pitch Attitude 

Roll Attitude 

wave 

At 

No. 


hhfi hi 

No. 

MM 

No. 

(deg) 

cycles 



cycles 

mSM 

1 

-1 

2 

0.19947 

-8 

3 

0.2992 

2 

1 

5 

0.49867 

-8 

4 

0.39893 

3 

1 

9 

0.8976 

8 

7 

0.69813 

4 

0.5 

14 

1.39626 

4 

18 

1.79519 

5 

-0.2 

24 

2.39359 

-1.6 

30 

2.99199 

6 

0.2 

42 

4.18879 

-1.6 

40 

3.98932 

7 

-0.08 

90 

8.97597 

0.64 

70 

6.98131 


O) 

0) 


TJ 

C 

CO 

E 

E 

o 

o 

■C 

O 

mmm 

a. 



Figure 8. Example Pitch Axis Sum-of-Sines Command Signal 

In the flight research of Ref. 6, the pitch SOS command resulted in load factors between about 0.5g and 
1.6g. Higher load factors are possible but will begin to require extremely large pilot inputs; lower load 
factors may not reveal much about the handling qualities of the airplane. 
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Desired and adequate performance limits are written in terms of mils of tracking error and are clearly 
geared toward a HUD. The format of these requirements is taken from Ref. 8, but the numbers are twice 
those used in Ref. 8. It was found in initial shakedown for the tests of Ref. 6 that the original limits were 
too small for the pilots to observe much less attempt to meet. 

Single-axis tracking may be obtained by simply turning off the command signal in one axis. This is 
perfectly acceptable and may be appropriate when the focus is on only one axis. Likewise, more than two 
axes may be tested simultaneously by cascading commands for more controls. For example, in the 
ground-based simulations of Ref. 7 tracking was performed in pitch, roll, and airspeed singly and in every 
combination. 

23.2.2 Task Description 
Objectives 

• Evaluate handling qualities in a tight, closed-loop tracking task. 

• Evaluate feel system and control sensitivity characteristics. 

• Identify bobble or PIO tendencies. 

Description 

Aggressively track the displayed signal and attempt to keep errors within the specified tolerances. 

Desired Performance 

• ±10 mils in pitch 50% of the time. 

• ±10 mils in roll (measured at the end of the command bar) 50% of the time. 

Adequate Performance 

• ±20 mils in pitch 50% of the time. 

• ±20 mils in roll (measured at the end of the co mman d bar) 50% of the time. 

2.3.3 Pitch and Roll Discrete Tracking (DT) 

2.3.3. 1 Background 

Tracking a computer-generated command signal produces a highly repeatable, precise task. Two of the 
most common types of tracking commands are the Veridian step-and-ramp (discrete tracking) and a sum- 
of-sinewaves. As mentioned above, the discrete task was found in two USAF TPS projects (Refs. 5 and 
6) to be better at producing repeatable, consistent pilot ratings. 

The discrete tracking task has been developed and refined by Veridian over the years, from the “Neal- 
Smith” task (Ref. 4) in pitch, to “LATHOS” (Ref. 9) in roll, and a pitch-and-roll combination (Ref. 10). 
The two-axis version presented here is the most recent, flown in both Refs. 5 and 6. Many of the 
subtleties of the task were provided by Veridian to the authors of 6 and are repeated here. 

Ideally, the display for this maneuver will be a head-up display (HUD) with an appropriate command bar 
and fixed pippers for desired and adequate performance. Realistically, however, such a display may be 
restricted only to experimental and research aircraft, at least for the near future, so the maneuver should 
not be limited only to HUDs. The display device may be the co mman d bars on a flight director, the 
glideslope and localizer bars on a horizontal situation indicator, etc. If a HUD is not used, the definitions 
of command scaling (units of actual error per displayed error) and performance limits become critical. In 
addition, for any display, the dynamics of the display drivers become important. Total throughput delay 
should at least be known, even if nothing can be done about it. 
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Table 4 lists the breakpoints for the pitch and roll co mman d signals as a function of time, Plots of the 
command signals are shown in Figure 9 and Figure 10. These signals may be scaled as needed to suit the 
load factor and roll rate ranges under study. In the flight research of Ref. 8 scale factors were applied in 
both pitch and roll, as described below. For Ref. 8, the pitch command resulted in load factors between 
about 0.3g and 2g. Higher load factors are possible but will begin to require extremely large pilot inputs; 
lower load factors may not reveal much about the handling qualities of the airplane. For this simulator 
evaluation the roll command was reduced by 25% to better meet the performance characteristics of the 
large transport aircraft simulation model. This reduction is reflected in Figure 10, while the original 
values remain in Table 4 for comparison. 

The signal displayed to the pilot is tracking error, not the command. When used by Veridian, there is a 
scale factor on the signal before it is displayed as well. In addition, Euler pitch attitude is adjusted for 
bank angle. In pitch, Odispiay = K e e {9 C -9'+ where K e g= 0.86, 6 C is the command (from the table), 
Obias is airplane attitude at the start of the task, and 6'= &cos{ </>). In roll, faispiay = K e £(j) c - <p + tpbias), where 
K t f = 0.88, <p c is the command (from the table), <p is bank angle, and (foias is airplane bank angle at the start 
of the task. The display of error, rather than pure command, makes the task compensatory in nature: the 
pilot compensates for displayed changes in attitude rather than pursuing an attitude command. 

Desired and adequate performance limits are written in terms of mils of tracking error and are clearly 
geared toward a HUD. The format of these requirements is taken from Ref. 8, but the numbers are twice 
those used in Ref. 8. It was found in initial shakedown for the tests of Ref. 6 that the original limits were 
too small for the pilots to observe much less attempt to meet. Single-axis tracking may be performed by 
zeroing the command signal in one axis. Veridian recommends, however, that two-axis tracking always 
be performed to assure good pilot-in-the-loop operations. 


Table 4. Breakpoints for Discrete Tracking Command Signals 


Time 

(sec) 

Pitch 

Command 

(dee) 

Roll 

Command 

(deg) 

Time 

(sec) 

Pitch 

Command 

(deg) 

Roll 

Command 

ideg) 

Time 

(sec) 

Pitch 

Command 

(deg) 

Roll 

Command 

_(deg) 

0 

0 

0 

45 

3 

-30 

92.6 

0 

0 

0.1 

2 

0.6 

45.1 

3 

0 

95 

0 

0 

5 

2 

30 

52.5 

3 

70 

95.1 

-1 

0 

5.5 

3 

30.6 

55 

3 

70 

97.5 

-1 

0 

10 

3 

60 

60 

1.5 

70 

97.6 

-1 

-70 

10.1 

2 

30 

65 

0 

-23.3 

100 

-i 

-70 

12.5 

2 

30 

67.5 

0 

-70 

102.5 

-1.67 

-70 

15 

0.33 

30 

70 

0 

-70 

107.5 

-3 

-23.3 

17.5 

-1.33 

-45 

70.1 

0 

-70 

no 

-3 

0 

20 

-3 

-30 

72.5 

0 

-70 

112.5 

-3 

0 

22.5 

2 

-15 

72.6 

-2 

-70 

112.6 

-1 

60 

25 

2 

0 

75 

-2 

-70 

115 

-1 

60 

25.1 

2 

15 

75.1 

0 

-70 

115.1 

3 

60 

27.5 

2 

30 

77.5 

0 

-70 

117.5 

3 

60 

30 

0 

45 

80 

0 

30 

117.6 

3 

-30 

35 

-3 

45 

80.1 

0 

30 

120 

3 

-30 

35.1 

-2 

43.5 

82.5 

0 

30 

120.1 

2 

-30 

37.5 

-2 

7.5 

85 

0 

30 

122.5 

2 

-30 

37.6 

-1 

6 

87.5 

0 

0 

126.6 

1 

-15 

40 

-1 

-30 

90 

0 

0 

127.5 

1 

-15 

42.5 

-1 

-30 

90.1 

0 

30 

127.6 

0 

0 

42.6 

3 

-30 

92.5 

0 

30 

150 

0 

• 0 
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Figure 9. Pitch Axis Discrete Command Signal 
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Figure 10. Roll Axis Discrete Command Signal 




2.3.3.2 Task Description 
Objectives 

• Evaluate handling qualities in a tight, closed-loop tracking task. 
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• Evaluate feel system and control sensitivity characteristics. 

• Identify bobble or PIO tendencies. 

Description 

Aggressively track the displayed signal and attempt to keep errors within the specified tolerances. 

Desired Performance 

• ±10 mils in pitch 50% of the time. 

• ±10 mils in roll (measured at the end of the command bar) 50% of the time. 

Adequate Performance 

• ±20 mils in pitch 50% of the time. 

• ±20 mils in roll (measured at the end of the command bar) 50% of the time. 

2.3.4 Pitch Attitude Capture and Hold (PACH) 

2.3.4.1 Background 

Flight and simulation evaluations of pitch capture tasks have shown that the pilot’s assessment of 
performance is greatly affected by the quality and type of visual display. For example, if a HUD pitch 
ladder with 5° increments is used, a 5° capture from a nonzero trim attitude means the pilot must judge 
performance with no obvious reference. If, on the other hand, the target attitude is a 5° line on the HUD, 
the pilot will have a more compelling cue. For this reason the Description refers to an attitude change of 
“at least 5°” and a target attitude that is clearly marked. 

2.3.4 .2 Task Description 
Objectives 

• Evaluate ability to pitch and capture an attitude. 

• Identify maneuverability limitations and PIO tendencies. 

Description 

From steady level flight rapidly capture a pitch attitude of at least 5° above trim and maintain this attitude 
within the specified tolerances for 5 seconds or until stable. The target attitude should be defined by a 
clearly displayed reference (e.g., a HUD pitch ladder). Then perform subsequent captures of the initial 
trim attitude, -5° below trim, and trim attitude to complete the maneuver. As with the initial capture, the 
actual target attitudes should again be defined by a clearly defmed reference. Before proceeding to the 
next capture, maintain each attitude within the specified tolerances for 5 seconds or until stable. Maintain 
wings level flight within the specified tolerances throughout the maneuver. 

Desired Performance 

• ±1° pitch attitude. 

• ±2° deviation in bank angle. 

• No more than one pitch attitude overshoot for each capture. Magnitude of overshoot remains 
within the desired region. 

Adequate Performance 

• ±2° pitch attitude. 
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• ±5° deviation in bank angle. 

• No more than one pitch attitude overshoot for each capture. Magnitude of overshoot remains 
within the adequate region. 

2.3.5 Bank Angle Capture and Hold (BACH) 

2.3.5.1 Background 

This maneuver is representative of a standard attitude capture task. 

2.3.5.2 Task Description 
Objectives 

• Evaluate ability to roll and capture a bank angle. 

• Identify maneuverability limitations and PIO tendencies. 

Description 

From steady, wings level flight roll and capture a bank angle of 45° and maintain this bank angle within 
the specified tolerance for 5 seconds or until stable. Capture the 45° bank angle before achieving a 
maximum heading change of 10°. Then capture and hold a bank angle of -45° and maintain this bank 
angle within the specified tolerance for 5 seconds or until stable. Finally, return to steady, wings level 
flight and maintain within the specified tolerance for 5 seconds or until stable. 

Desired Performance 

• ±2° bank angle. 

• No more than one bank angle overshoot for each capture. Magnitude of overshoot remains 
within the desired region. 

Adequate Performance 

• ±5° bank angle. 

• No more than one bank angle overshoot for each capture. Magnitude of overshoot remains 
within the adequate region. 

2.3.6 Flightpath Capture and Hold (FPCH) 

2.3.6. 1 Background 

Precise control of flightpath, while maintaining airspeed, is critical for many operational elements. This 
maneuver is aimed specifically at evaluating path/speed coupling that might degrade the ability to 
perform aerial recovery or rendezvous tasks. 

2.3.6.2 Task Description 
Objectives 

• Evaluate ability to maintain airspeed during initiation of climbs and descents. 

• Evaluate coupling between airspeed and flightpath. 

Description 

From steady level flight, rapidly pitch over and reduce power to attain a steady dive angle of -5° within 
the specified tolerances. After an altitude loss of 500 ft, rapidly pitch up and increase power to attain a 
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steady climb angle of 5° within the specified tolerances. Smoothly level off at the initial altitude. Repeat 
the maneuver by first climbing and then diving. 

Desired Performance 


• ±1° deviation in flightpath angle. 

• Attain target descent and climb angles with no more than one overshoot. Magnitude 
of overshoot remains within the desired region. 

• ±10 kt deviation in airspeed. 

Adequate Performance 


• ±2° deviation in flightpath angle. 

• Attain target descent and climb angles with no more than one overshoot. Magnitude 
of overshoot remains within the adequate region. 

• ±20 kt deviation in airspeed. 


2.3.7 Altitude Rate Capture and Hold (ARCH) 

2.3.7. 1 Background 

This maneuver is representative of a standard altitude rate capture task. Without a direct readout of rate, 
however, the evaluation pilot will need to determine the appropriate pitch attitudes that correspond to the 
desired climb and descent rates. 


2.3.7 .2 Task Description 
Objectives 

• Evaluate precision climb rate characteristics in isolation. 

• Evaluate phugoid stability. 

Description 

From steady level flight rapidly capture and maintain a climb rate of 1,000 fpm for an altitude change of 
500 ft. Then immediately capture and hold a sink rate of 1,000 fpm and return to the initial altitude. 
Then immediately return to level flight. Power should be held constant throughout the maneuver. To 
evaluate potential low frequency problems maintain steady conditions for at least 30 seconds to start and 
end the maneuver and at the acquired climb and sink rates. 

Desired Performance 

• ±100 fpm deviation in climb or sink rate. 

• No more than one climb or sink rate overshoot. Magnitude of overshoot remains within the 
desired region. 

Adequate Performance 

• ±300 fpm deviation in climb or sink rate. 

• No more than one climb or sink rate overshoot. Magnitude of overshoot remains within the 
adequate region. 
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2.3.8 Precision DLS Capture and Track (ILS) 

2.3.8. 1 Background 

Ability to capture and precisely track an ILS (Instrument Landing System) signal depends upon good 
airspeed stability and control as well as favorable path/speed coupling. This maneuver is written 
specifically in terms of an ILS command signal, but it is not meant to be used only when an ILS is to be 
used. It may be applied for other ground-based, or even aircraft-based (such as GPS), landing signals 
intended for operations in IMC. The requirements for precision, written here in terms of conventional 
“dots,” will need to be converted to comparable requirements for other types of displays. 

2.3.8.2 Task Description 
Objectives 

• Evaluate ability to acquire and track an approach signal in IMC. 

• Evaluate speed stability (control force per knot). 

• Identify path/speed coupling in IMC. 

Description 

With the aircraft configured for final approach and from an approach course that is offset at least lVi dots 
laterally and vertically, rapidly maneuver to reacquire centerline of the ILS beam. Start correction when 
the aircraft is 5 nm from the runway threshold, or as it crosses the outer marker. The most critical 
combination of offsets (high, low, left, right) should be emphasized. Track the ILS beam until the 
missed-approach point or an altitude of 400 ft AGL, whichever is higher. 

Desired Performance 

• Attain trimmed flight on the ILS (within desired performance limits) at a range from 
the runway of 2 nm or greater. 

• Maintain trimmed approach speed within ±5 kts. 

• Maintain glideslope and localizer within ±Vi dot. 

Adequate Performance 

• Attain trimmed flight on the ILS (within adequate performance limits) before 
crossing the middle marker (approximately 0.5 nm from the runway). 

• Maintain trimmed approach speed within ±10 kts. 

• Maintain glideslope and localizer within ±1 dot. 

2.3.9 Precision Offset Landing (POL) 

2.3.9. 1 Background 

The offset landing has become a common task for evaluation of handling qualities in landing formation. 
As recently as the 1960s and early ‘70s, it was not unusual for “landing” handling-qualities evaluations 
tasks to end with a low approach. But it has since become clear that the final few feet before main-gear 
touchdown are critically important in exposing any dangerous deficiencies. The landing task has evolved 
to include lateral offsets from the runway centerline, both to investigate lateral handling qualities and to 
force the pilot to maneuver aggressively just prior to touchdown. When flown on variable-stability 
aircraft at Veridian, one or two vertical gusts (with a (1 -cosine) shape) are injected on short final to 
further perturb the airplane from a stable approach. 
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The task as described here is taken from the 1995 Notice of Change to MEL-STD-1797A (Ref. 1 1). It has 
been modified and clarified based upon the review of the offset landing task documented in Ref. 12. 

Based on a careful review of the precision offset landing, both the offset correction altitude and the length 
of the touchdown box have been made variables that are functions of groundspeed. Experience has 
shown that aircraft approach speed and ambient winds can combine to introduce great variability to the 
landing task. An airplane that has a very low approach airspeed, or an airplane with a high approach 
airspeed in a strong headwind, will have a much easier task than a high-speed airplane in no winds or in a 
tailwind. The landing box lengths are nominally 400 and 1,000 ft for desired and adequate performance, 
respectively, for an airplane with an approach speed of 132 kts and no wind. This is roughly the approach 
speed of the USAF TIFS and NT-33A (operated by Veridian) from which the bulk of experience with this 
maneuver comes. We have assumed that KIAS is approximately equal to groundspeed for flight 
experiments with these aircraft. 

Obviously, including task descriptions and performance parameters that are based on a variable such as 
wind can make the definition of the task difficult at best. It is not intended that the offset altitude and 
landing box size change from run to run, but rather that they be adjusted whenever there is a sufficiently 
large wind to justify such a change. A good rule of thumb is that any difference in approach speed from 
132 kts should be accounted for when it will result in a change in offset altitude of 20 ft or more or a 
change in box length of 100 ft or more. 

Although it is not specified in the maneuver, a clearly defined aimpoint for the landing can greatly 
improve performance. Such an aimpoint may be a large white box (5 ft by 5 ft or larger) or a line, 
typically placed V* of the way down the desired landing zone. Lack of such a target sometimes results in 
apparent landing scatter simply because different pilots will use different target points on the runway 

2.3 .9.2 Task Description 
Objectives 

• Evaluate ability to precisely control horizontal and vertical flightpath and airspeed. 

• Evaluate ability to precisely control sink rate and attitude in the flare. 

• Evaluate tendency for nose bobble or PIO. 

• Evaluate control sensitivity and harmony in landing. 

Description 

Initiate the maneuver approximately one mile out on final approach with a lateral offset of 200 ft from the 
runway centerline and on glideslope. The approach angle (glideslope) shall be as appropriate for the 
aircraft being tested (roughly 3° for conventional approach). At 200 ft AGL aggressively correct the 
lateral offset to land on the runway centerline with wings level. This is for an approach groundspeed of 
132 kts. If approach groundspeed differs from this speed by more than 10 kts, adjust the offset correction 
altitude by 1.515*(V G /s - 132), where V G /s is the approximate groundspeed in the approach (in kts). 
Touch down within the prescribed touchdown zone with the aircraft centerline within die width of the 
zone and the main gear within the length of the zone. The task may be performed in any wind or 
turbulence conditions as allowed by the operational limits of the aircraft. Testing in extreme wind 
conditions (crosswinds and shears) is recommended. Additional constraints that are necessary for safety 
may be implemented as appropriate. For example, restrictions may be placed on bank angles attained by 
large aircraft at low altitude. 

Desired Performance 

• Touch down within ±5 kts of landing airspeed. 
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• Touch down in a box that is 20 ft wide by 400 ft long. This is for an approach 
groundspeed of 132 kts. If approach groundspeed differs from this speed by more 
than 10 kts, adjust the box length by 3.03*(Vg/s - 132), where V G/S is the approximate 
groundspeed in the approach (in kts). 

• Touchdown sink rate less than 4 fps (or no bounce and no hard landing if touchdown 
sink rate is difficult to measure). 

Adequate Performance 

• Touch down within ±10 kts of landing airspeed. 

• Touch down in a box that is 40 ft wide by 1,000 ft long. This is for an approach 
groundspeed of 132 kts. If approach groundspeed differs from this speed by more 
than 10 kts, adjust the box length by 7.576*(V G /s - 132), where V G/S is the 
approximate groundspeed in the approach (in kts). 

• Touchdown sink rate less than 6 fps or 80% of the gear limit, whichever is greater (or 
no more than one bounce and no hard landing if touchdown sink rate is difficult to 
measure). 

2.4 Simulated Flight Control System Failures 

A list of flight control system changes that can be induced in real-time using the simulator change-a-gain 
feature is provided in Table 5. The demonstration maneuvers that will be used with a given scenario are 
also identified in the table. It is anticipated that this table will be revised pending the results of the 
simulation checkout. 


Table 5. Simulated Flight Control System Failures 



ID 

Description 

Demonstration Maneuvers 

1 

PitchTC 

Alter pitch stick filter time constant 

All pitch axis and dual axis tasks 

2 

PitchGS 

Alter pitch stick gain shaping 

All pitch axis and dual axis tasks 

3 

PitchTD 

Inject pitch stick time delay 

DT, SOS, PACH, POL, STOL/POL 

4 

RollTD 

Inject roll stick time delay 

DT, SOS, BACH, POL, STOL/POL 

5 

QGain 

Alter pitch rate feedback 

- 

All pitch axis and dual axis tasks 

6 

PGain 

Alter roll rate feedback 

All roll axis and dual axis tasks 

7 

QLIM 

Reduce pitch rate command path limiter 

DT, SOS, PACH, POL, STOL/POL 

8 

PLIM 

Reduce roll rate command path limiter 

DT, SOS, BACH, POL, STOL/POL 


2.5 Requirements and Procedures 

2.5.1 Simulator Facility Requirements 

2.5. 1.1 LOCATS Host PC 

To ease logistical and potential security constraints, BAE SYSTEMS acquired the host PC that was 
integrated into the simulator facility. The host PC was equipped as follows: 

• Windows 2000 OS; 

• Pentium IV 2.4 GHz or higher processor with 1 GB ram; and 

• ATI Radeon video card. 
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In addition the PC included a dual-channel SBS 1553 Bus Monitor card to access simulator data, 

2.5. 1.2 Simulator HUD 

When performing the up-and-away pitch and roll tracking tasks, an error bar and desired and adequate 
performance target pippers of 10 and 20 milliradian radii, respectively, will be superimposed on the HUD 
as shown in Figure 11. The error bars will indicate the difference between the commanded attitudes and 
the actual attitudes as shown in Figure 12. It will be the goal of the pilot to minim ize this error. The 
desired and adequate performance requirements are set to the values defined in the above SOS and DT 
task descriptions. 



Figure 11. Head-Up Display with Pitch and Roll Tracking Task Symbology 



Figure 12. Tracking Task Command Bar Implementation in the BAE SYSTEMS Simulator 
2.5.1 .3 Data Requirements 

Table 6 contains a list of variables that will acquired off the Flight Control Computer (FCC) bus by the 
LOCATS software. All data runs will be saved to the LOCATS host PC hard disk and later archived to 
CD. 
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Table 6. Minimum Set of Parameters for LOCATS Software 


Parameter 



MACH 


H 


CG 


LBD 


GBD 


Parameter Description 


Flight Condition and Aircraft Configuration Variables 


Calibrated Airspeed 


True Airspeed 


Mach Number 


Altitude 


Center of Gravity 


Localizer Beam Deviation 


Glideslope Beam Deviation 


Comment 



ft 


%MAC 


DDM 


DDM 


Pressure altitude 



Pilot Command Inputs 


FLON 

Pitch Stick Force 

lbs 

DLON 

Pitch Stick Position 

inches 

FLAT 

Roll Stick Force 

lbs 

DLAT 

Roll Stick Position 

Inches 

FP 

Rudder Pedal Force 

lbs 

DP 

Rudder Pedal Position 

deg 

DT 

Throttle Lever Angle 

deg 



Aircraft Control Surfaces 


DEC 

Elevator Command 

deg 

DE_LIB 

Left Inboard Elevator Position 

inches 

DE.LOB 

Left Outboard Elevator Position 

Inches 

DE.RIB 

Right Inboard Elevator Position 

Inches 

DE_ROB 

Right Outboard Elevator Position 

inches 

DACJL 

Left Aileron Command 

deg 

DAC_R 

Right Aileron Command 

_ _ 

deg 

DAJL 

Left Aileron Position 

inches 

DA_R 

Blight Aileron Position 

inches 

DRC 

Rudder Command 

deg 

DR_L 

Lower Rudder Position 

inches 

DR_U 

Upper Rudder Position 

inches 

DFLAP 

Flap Position 

deg 

DSP 

Spoiler Position 

deg 


Local actuator position 


Local actuator position 


Local actuator position 


Local actuator position 



Local actuator position 


Local actuator position 


Lower 


Local actuator position 


Local actuator position 


Average 


Average 


Aircraft Response Variables 
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Parameter 


p 

Roll Rate 

deg/sec 


PHI 

Roll Attitude 

rad 

Units specified by airframer 

R 

Yaw Rate 

deg/sec 


TPS I 

True Heading 

deg 

ISM selected 

ALPHA 

Angle of Attack 

Deg 


BETA 

Angle of Sideslip 

deg 

Estimated 

GAMMA 

Flightpath Angle 

deg 


AZ 

Vertical Acceleration 



NZ 

Load Factor 

g 

Estimated 

NX_CG 

Longitudinal Acceleration at CG 

g 


NY_CG 

Lateral Acceleration at CG 

g 


NZ_CG 

Normal Acceleration at CG 

g 


HD 

Altitude Rate 

ft/min 

Sink Rate 

Flight Control System Variables 

GKP4 

Pitch Stick Filter Time Constant 


PRC mode 

GKP5 

Pitch Stick Filter Time Constant 


PAC mode 

GKP6 

Pitch Stick Filter Time Constant 


TO mode 

GPFPT1 

Pitch Stick Gain Shaping 



GPFPT2 

Pitch Stick Gain Shaping 



GPFPT3 

Pitch Stick Gain Shaping 



GKQ 

Pitch Rate Feedback Gain 




Flight Control System Variables (Continued) 


GKP 

Roll Rate Feedback Gain 



QCRL 

Pitch Rate Command Limiter 




Roll Rate Command Limiter 




Pitch Stick Delay 

msec 


R_Delay 

Roll Stick Delay 

msec 
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2.5.2 Procedures 

In general, the piloted simulation will be conducted as a standard handling qualities evaluation. The 
sessions will begin with a pilot briefing that will include a discussion of the evaluation tasks and 
qualitative data requirements (i.e., comments and ratings). If necessary, the pilot will then be given a 
simulator demonstration with an emphasis on the features relevant to die evaluation tasks. Before the 
formal evaluation process begins, the pilot will be given an opportunity to practice the tasks. 

A given evaluation will consist of four distinct variables: configuration, flight condition (speed, 
crosswinds, etc.), task, and loss of control scenario. A sample run log is presented in Table 7 that 
contains the run number, configuration identifier, flight condition identifier, flight control systen failure 
scenario, pilot ratings, and comments. When appropriate to the LOCATS evaluation, the pilot will be 
required to perform a given task at least twice before ratings and comments will be taken. In practice, the 
pilot will be able to repeat the tasks as many times as is necessary to provide ratings with confidence. 
Detailed commentary should be provided for each task, supplemented by an additional indication of the 
pilot’s confidence in the rating(s) assigned. Identification of those situations demanding unusually high 
workload, high degree of singular focus on the task, unexpected aircraft responses, etc. are particularly 
important. Although there will be a recommended evaluation order for a given session, the experimenter 
will be free to make changes as needed. 

For any given run a simulated flight control system failure (see Table 5) may be introduced at the 
discretion of the test conductor. These “random” events are designed to test the capabilities of the 
LOCATS. 

2.6 LOCATS Evaluation Success Criteria 

There are two fundamental factors that will determine the ultimate success of the LOCATS concept. 
First, the LOCATS software must be able to detect impending loss of control events while minimizing 
“false alarms” and/or missed events. Second, the time to detection must be minimized, so that the pilot or 
automatic flight control system can react to the situation. Thus for a given flight control system failure 
scenario, the following questions will be addressed: 

• Can the wavelet-based computations run in a real-time enviro n ment? 

• Was loss of control or impending loss of control observed? 

• If yes, what was the triggering event? 

• If yes, was the event detected by the LOCATS software? 

• If no, was a non-event detected by the LOCATS software? 

• What metric(s) provided the detection mechanism? 

• What was the detection time? 

• Can the detection time be improved? 

Later versions of the LOCATS software may include recommended courses of action that could be 
provided to the pilot in the form of a flight director or as direct commands to flight control system 


TR 1341-2 


22 


Table 7. Example Run Log 


FC 

Configuration 

Task 

FCS 

Comments 










3. LOCATS SIMULATION CHECKOUT 


3.1 Summary 

The LOCATS simulation checkout was conducted at the BAE SYSTEMS facility in Johnson City, NY 
from 23 to 27 June 2003. The objectives for the checkout were as follows: 

• Install required software and otherwise configure the LOCATS host PC; 

• Configure the SBS Technologies 1553 data bus card and integrate the card with LOCATS 
software; 

• Assess and refine aircraft configurations and flight conditions; 

• Collect diagnostic data for each aircraft configuration at its nominal flight condition (i.e., no 
crosswinds or turbulence) 

• Evaluate and refine pilot tasks; and 

• Assess loss of control scenarios. 

Although there were several key issues to resolve, by the end of the five day checkout all objectives were 
met. Further details on aircraft configuration verification and loss of control scenario assessment are 
provided below. 

3.2 LOCATS DATA ACQUISITION 

A significant effort during the simulation checkout week was spent in creating the dynamic link library 
(DLL) that was required for the LOCATS software to access simulator data off of the 1553 data bus. 
Most of this effort was expended on proper configuration of the SBS Technologies 1553 data bus card. 
Although the card had a dual bus capability, it could only be configured to read data from one bus at a 
time despite the best efforts of STI and BAE SYSTEMS personnel. The good news was that the majority 
of the signals that STI requested be made available were located on a single data bus. In the end only six 
signals could not be recorded. The bad news was that these signals were those necessary to identify the 
pilot describing function from the SOS and discrete tracking tasks. When fully integrated with LOCATS 
at the end of the checkout session, the software could read, display, and record simulator data at 50 Hz. 

3.3 Configuration Review 
3.3.1 Run Log 

As part of the simulation checkout diagnostic maneuvers were conducted on the ten aircraft 
configurations. A complete run log is provided in Table 8. 


Table 8. Simulation Checkout Run Log 


Run 

Configuration 
(BAE SYSTEMS ID) 

Description 

Task 

i 

CHF (still) 

Cruise/Heavy/FwdCG 

Pitch Axis Frequency Sweep 

2 

CHF (still) 

Cruise/Hea vy/F wdCG 

Pitch Axis Pulse 

3 

CHF (still) 

Cruise/Heavy/FwdCG 

Pitch Axis Doublet 

4 

CHF (still) 

Cruise/Heavy/FwdCG 

Roll Axis Frequency Sweep 

5 

CHF (still) 

Cruise/Heavy/FwdCG 

Roll Axis Pulse 

6 

CHF (still) 

Cruise/Heavy/FwdCG 

Roll Axis Doublet 

7 

CHA (stil2) 

Cruise/Heavy/ AftCG 

Pitch Axis Frequency Sweep 
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Rim 

Configuration (BAE 
SYSTEMS ED) 

Description 

Task 

8 

CHA (stil2) 

Cruise/Heavy/AftCG 

Pitch Axis Pulse 

9 

CHA (stil2) 

Cruise/Heavy/AftCG 

Pitch Axis Doublet 

10 

CHA (stil2) 

Cruise/Heavy/AftCG 

Roll Axis Frequency Sweep 

11 

CHA (sti.12) 

Cruise/Heavy/AftCG 

Roll Axis Pulse 

12 

CHA (stil2) 

Cruise/Heavy/AftCG 

Roll Axis Doublet 

13 

CLF (stil3) 

Cruise/Light/FwdCG 

Pitch Axis Frequency Sweep 

14 

CLF (stil3) 

Cruise/Light/FwdCG 

Pitch Axis Pulse 

15 

CLF (stil3) 

Cruise/Light/FwdCG 

Pitch Axis Doublet 

16 

CLF (sti.13) 

Cruise/Light/FwdCG 

Roll Axis Frequency Sweep 

17 

CLF (stil3) 

Cruise/Light/FwdCG 

Roll Axis Pulse 

18 

CLF (stil3) 

Cruise/Light/FwdCG 

Roll Axis Doublet 

19 

CLA (stil4) 

Cruise/Light/AftCG 

Pitch Axis Frequency Sweep 

20 

CLA (stil4) 

Cruise/Light/AftCG 

Pitch Axis Pulse 

21 

CLA (stil4) 

Cruise/Light/AftCG 

Pitch Axis Doublet 

22 

CLA (stil4) 

Cruise/Light/AftCG 

Roll Axis Frequency Sweep 

23 

CLA (stil4) 

Cruise/Light/AftCG 

Roll Axis Pulse 

24 

CLA (stil4) 

Cruise/Light/AftCG 

Roll Axis Doublet 

25 

AHF (sti35) 

Approach/Heavy/FwdCG 

Pitch Axis Frequency Sweep 

26 

AHF (sti35) 

Approach/Heavy/FwdCG 

Pitch Axis Pulse 

27 

AHF (sti35) 

Approach/Heavy/FwdCG 

Pitch Axis Doublet 

28 

AHF (sti35) 

Approach/Heavy/FwdCG 

Roll Axis Frequency Sweep 

29 

AHF (sti35) 

Approach/Heavy/FwdCG 

Roll Axis Pulse 

30 

AHF (sti35) 

Approach/Heavy/FwdCG 

Roll Axis Doublet 

31 

AHA (sti.36) 

Approach/Heavy/AftCG 

Pitch Axis Frequency Sweep 

32 

AHA (sti36) 

Approach/Heavy/AftCG 

Pitch Axis Pulse 

33 

AHA (sti36) 

Approach/Heavy/AftCG 

Pitch Axis Doublet 

34 

AHA (sti36) 

Approach/Heavy/AftCG 

Roll Axis Frequency Sweep 

35 

AHA (sti36) 

Approach/Heavy/AftCG 

Roll Axis Pulse 

36 

AHA (sti36) 

Approach/Heavy/AftCG 

Roll Axis Doublet 

37 

ALF (sti39) 

Approach/Light/FwdCG 

Pitch Axis Frequency Sweep 

38 

ALF (sti39) 

Approach/Light/FwdCG 

Pitch Axis Pulse 

39 

ALF (sti39) 

Approach/Light/FwdCG 

Pitch Axis Doublet 

40 

ALF (sti39) 

Approach/Light/FwdCG 

Roll Axis Frequency Sweep 

41 

ALF (sti39) 

Approach/Light/FwdCG 

Roll Axis Pulse 
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Run 

Configuration 
(BAE SYSTEMS ID) 

Description 

Task 

42 

ALF (sti39) 

Approach/Light/FwdCG 

Roll Axis Doublet 

43 

ALA (sti3A) 

Approach/Light/AftCG 

Pitch Axis Frequency Sweep 

44 

ALA (sti3A) 

Approach/Light/AftCG 

Pitch Axis Pulse 

45 

ALA (sti3A) 

Approach/Light/AftCG 

Pitch Axis Doublet 

46 

ALA (sti3A) 

Approach/Light/AftCG 

Roll Axis Frequency Sweep 

47 

ALA (sti3A) 

Approach/Light/AftCG 

Roll Axis Pulse 

48 

ALA (sti3A) 

Approach/Light/AftCG 

Roll Axis Doublet 

49 

SALF (sti57) 

Steep Approach/Light/FwdCG 

Pitch Axis Frequency Sweep 

50 

SALF (sti57) 

Steep Approach/Light/FwdCG 

Pitch Axis Pulse 

51 

SALF (sti57) 

Steep Approach/Light/FwdCG 

Pitch Axis Doublet 

52 

SALF (sti57) 

Steep Approach/Light/FwdCG 

Roll Axis Frequency Sweep 

53 

SALF (sti57) 

Steep Approach/Light/FwdCG 

Roll Axis Pulse 

54 

SALF (sti57) 

Steep Approach/Light/FwdCG 

Roll Axis Doublet 

55 

SALA (sti58) 

Steep Approach/Light/AftCG 

Pitch Axis Frequency Sweep 

56 

SALA (sti58) 

Steep Approach/Light/AftCG 

Pitch Axis Pulse 

57 

SALA (sti58) 

Steep Approach/Light/AftCG 

Pitch Axis Doublet 

58 

SALA (sti58) 

Steep Approach/Light/AftCG 

Roll Axis Frequency Sweep 

59 

SALA (sti58) 

Steep Approach/Light/AftCG 

Roll Axis Pulse 

60 

SALA (sti58) 

Steep Approach/Light/AftCG 

Roll Axis Doublet 


3.3.2 Example Diagnostic Maneuver Time Histories 

As described previously, the DLL needed to read, display, and record simulator data through LOCATS 
was not completed until the end of the checkout session. A subset of the required data set from Table 6 
was made available for storage using the BAE SYSTEMS file saving capabilities. It was wrongly 
assumed by STI personnel that the data would be recorded at the 50 Hz update rate available over the 
FCS data bus. The data, however, were actually stored in a print file format at an update rate of 
approximately 8 Hz. To further complicate matters key output variables were saved in a separate file 
from the input variables that had a unique time stamp and update rate. Example pitch and roll axis 
frequency sweep time histories are shown in Figure 13 and Figure 14, respectively. Note that the 
coarseness of the data is clearly evident in the pitch (THE) and roll (PHI) attitude traces. To remedy this 
problem, diagnostic maneuvers were repeated during the formal evaluation simulator sessions (see 
Section 3) for all of the configurations used in the LOCATS assessment. 
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3.4 Assessment of Maneuvers and Simulated Flight Control Failures 

3.4.1 Maneuvers 

Going into the checkout session it was assumed that the SOS and discrete tracking tasks would provide 
the high gain environment needed to induce pilot-vehicle system loss of control in the form of pilot- 
induced oscillations. There was considerable concern among the BAE SYSTEMS personnel that the 
tasks were beyond the capabilities of the transport aircraft modeled in the simulator. It was to the good 
fortune of this program that the STI evaluation pilot had spent hours in the simulator flying similar HUD 
tracking tasks as part of his dissertation research. In the end the aircraft was capable of performing the 
SOS tasks with no adjustments to the task. For the discrete tracking tasks the pitch axis command 
magnitudes were left unchanged, while the roll axis commands were reduced by 25% to avoid some 
maneuvering restrictions. BAE SYSTEMS personnel included an option in the simulator that allowed the 
tracking tasks to be flown as either single or dual axis. Selection of the type of task was made via a toggle 
switch. 

The pitch and bank attitude capture and hold tasks (PACH and BACH) also worked out quite well. What 
is especially effective about these single axis tasks is the ability to modulate the aggressiveness of the 
task. Once the pilot is comfortable with a configuration, it is possible to fly the task essentially open-loop 
with well timed and sized inputs. It was, however, possible to avoid this situation by having the pilot 
aggressively attempt to minimize the capture errors, thus ensuring a higher gain, closed-loop task. 
Reducing the capture attitudes also kept the pilot in the loop. 

The flightpath capture and hold and altitude rate capture and hold tasks were not as interesting. Once the 
maneuver was initiated, there was significant dwell times, while the pilot waited for the large aircraft to 
climb and descend. The control activity of the pilot was clearly not at the same level as the HUD tracking 
or PACH and BACH maneuvers. 

Significant effort was expended evaluating the offset landing tasks. One problem in particular arose from 
the limitations of the simulator visual scene. It was just not possible to create the cues necessary to fly the 
task as defined in Ref. 1. The BAE SYSTEMS personnel did an impressive job of adjusting the localizer 
and glideslope beam deviation flight director bars to mimic the offset landing task. The maneuver began 
with a fairly low gain beam capture task and ended with a lagged offset correction via the flight director 
that, in the final analysis, could not replicate the required correction to centerline. 

3.4.2 Failures 

Flight control failures were introduced into the simulator at the discretion of the operator using the 
simulator change-a-gain feature. This feature allowed flight control system parameters to be varied from 
a default value to some new value, while the simulator was operating. The change-a-gain feature 
provided a choice of eight parameter values including the default value. Because of the interest in 
inducing loss of control, only the most severe changes from the default value were used. As identified in 
Table 5 eight flight control system changes were selected for the checkout phase. The default and 
changed values for each flight control system change are identified in Table 9. The change-a-gain 
parameters listed in the table were included in the data sets recorded by LOCATS. Thus the actual 
changed value for a given ran could be easily verified. 

To exercise the change-a-gain option three typed entries had to be made at the operator station. This 
entry procedure did not pose a problem for single parameter changes, since the change did not engage 
until the final entry was made. For changes that involved multiple entries, however, it was difficult for 
the operator to make the required entries in a timely matter. As a result the PitchGS, which had three 
parameters or nine required entries, was not used. 

After the evaluation pilot was comfortable with the evaluation tasks, the various flight control system 
failure scenarios were investigated. As expected the pitch (QGain) and roll (PGain) rate feedback gain 


TR 1341-2 


29 



failures worked well with the intended tasks. It was observed that the pitch axis was more sensitive to 
this augmentation failure then was the roll axis. 


Table 9. Change-a-Gain Values for Simulated Flight Control System Failures 


No. 

ID 

Default Value 

Changed Value 

1 

PitchTC 

0 sec 

0.25 sec 

2 

PitchGS 

Not Used 

Not Used 

3 

PitchTD 

0 msec 

240 msec 

4 

RollTD 

0 msec 

240 msec 

5 

QGain 

0.4 

0 

6 

PGain 

1.0 

0 

7 

QLIM 

25 deg/sec 

7.5 deg/sec 

8 

PLIM 

120 deg/sec 

36 deg/sec 


The default pitch control system had no stick filter. Thus, the change associated with the PitchTC 
essentially added a co mman d path lag to the system. The addition of this lag was noticed by the pilot 
although the effects were not dramatic. 

The next set of changes that were assessed was the reduction of the co mman d path limiters. Because it is 
difficult to generate sustained pitch rates with the simulated transport aircraft, the pitch command limiter 
had no real effect, even at its lowest value. Reduction of the roll command path limiter, on the other 
hand, was quite effective, particularly during the discrete tracking task. 

The final flight control system changes that were evaluated were the pitch and roll stick added time 
delays. Because the baseline aircraft can appear sluggish in aggressive maneuvering, the added time 
delays did not pose a significant problem for die pilot. He seemed to compensate for the added delay with 
relative ease. Although this result was somewhat unexpected, it has been difficult in the past to induce 
unfavorable pilot-vehicle system coupling in a fixed base simulator with time delay alone. Including the 
added time delay in combination with other failures produced much more promising results. 

3.5 Evaluation Pilot Background 

Dr. Ed Bachelder of STI served as the evaluation pilot for both the simulation checkout and the formal 
LOCATS evaluation sessions. As a Naval Aviator Dr. Bachelder was a Helicopter Aircraft Commander 
for the SH-60B Seahawk. During the Navy flight training syllabus he flew the T-34C turboprop and the 
TH-57B/C. He logged a total of 926 hours while on active duty. In addition, he logged approximately 
2000 hours in a helicopter simulator, largely performing hover tracking tasks, while conducting his 
doctoral research work at MIT. 
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4. LOCATS SIMULATION EVALUATION 


4.1 Summary 

4.1.1 Overview 

The formal LOCATS simulation evaluation was conducted at the BAE SYSTEMS facility in Johnson 
City, NY from 28 July to 1 August 2003. The objectives for the evaluation were as follows: 

• Install latest versions of the LOCATS software on the LOCATS host PC; 

• Conduct diagnostic maneuvers on all aircraft configurations used in the formal evaluations; 

• Verify that the waVelet-based algorithms can run in real time; 

• Evaluate the ability of LOCATS to detect pilot-vehicle system changes; and 

• Assess the ability of the LOCATS metrics to predict loss of control. 

The results of the LOCATS evaluation are documented in Volume I of this report. 

4. 1 .2 Pilot Evaluation Tasks 

The pilot evaluation tasks used in the LOCATS evaluation were as follows: 

• Pitch Attitude Capture and Hold (PACH); 

• Bank Angle Capture and Hold (BACH); 

• Pitch and Roll Sum-of-Sines Tracking (SOS); and 

• Pitch and Roll Discrete Tracking (DT). 

The offset landing tasks were not used in the formal evaluation because of limited effectiveness given the 
constraints of the implementation. The altitude rate, altitude, flightpath, and ILS capture and hold tasks 
were discarded because the long periods of essentially open-loop control were not conducive to loss of 
control. 

4.1.3 Revised Simulated Flight Control System Failures 

Table 10 provides a revised list of simulated flight control system failures based on the results of the 
simulation checkout. In addition, a new scenario was introduced involving the roll axis. As the formal 
evaluations progressed it became clear that loss of control in the roll axis (i.e., PIO or otherwise) could 
not be induced with the available flight control system changes. To help “loosen” up the roll axis, a new 
change-a-gain option was made available that eliminated the sideslip rate feedback in the roll axis via the 
GBDEST gain. Eliminating this gain alone did not produce a noticeable change to the pilot. When used 
in conjunction with the elimination of the roll rate feedback, however, it was possible to generate at a 
minimum mild PIO in the roll axis. To coordinate its use in the evaluation process, this gain change was 
only used in conjunction with a PGain change. As mentioned in the previous section, multiple key 
strokes are required to make a single change. Because it was not possible to add the GBDEST to the 
saved signal list, the BGain change was always made first, followed by the PGain. 

Table 11 gives an updated list of the change-a-gain values used in the LOCATS formal evaluation. 
Included in this list are the values for the BGain changes. 
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Table 10. Revised Simulated Flight Control System Failures 


No. 

ID 

Description 

Demonstration Maneuvers 

1 

PitchTC 

Alter pitch stick filter time constant via 
change-a-gain 

All pitch axis and dual axis tasks 

2 

PitchTD 

Inject pitch stick time delay 

DT, SOS, PACH 

3 

RollTD 

Inject roll stick time delay 

DT, SOS, BACH 

4 

QGain 

Alter pitch rate feedback via change-a-gain 

All pitch axis and dual axis tasks 

5 

PGain 

Alter roll rate feedback via change-a-gain 

All roll axis and dual axis tasks 

6 

BGain 

Alter GBDEST via change-a-gain 
(only used in conjunction with PGain) 

All roll axis and dual axis tasks 

7 

QLIM 

Reduce pitch rate command path limiter 

DT, SOS, PACH 

8 

PLIM 

Reduce roll rate command path limiter 

DT, SOS, BACH 


Table 11. Updated Change-a-Gain Values for Simulated Flight Control System Failures 




No. 

ID 

Default Value 

Changed Value 

1 

PitchTC 

0 sec 

0.25 sec 

2 ! 

PitchTD 

0 msec 

240 msec 

3 

RollTD 

0 msec 

240 msec 

4 

QGain 

0.4 

0 

5 

PGain 

1.0 

0 

6 

BGain 

1.2 

0.2 

7 

QLIM 

25 deg/sec 

7.5 deg/sec 

8 

PLIM 

120 deg/sec 

36 deg/sec 


4.2 Run Log 

A run log for the five simulator sessions conducted as part of the LOCATS formal evaluation is provided 
in Table 12. During the formal evaluation of the LOCATS system 122 analysis runs were completed. Of 
these 41 were diagnostic maneuvers that are used to characterize the configurations used in the formal 
evaluation. The diagnostic maneuvers included pitch and roll axis doublets and pitch and roll axis 
frequency sweeps. The maneuvers were conducted with autothrottle on and off. Throttle frequency 
sweeps were conducted with the autopilot on and off. The remaining 81 maneuvers featured the flight 
control system failure scenarios defined in Table 10. Because of the limitations of the types of failures 
that could be introduced via the change-a-gain feature, the aircraft could not be made to depart. It was 
possible, however, to repeatedly produce significant pilot-induced oscillations as indicated in the 
“Comments” column of Table 12. 
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Table 12. LOCATS Simulation Evaluation Run Log 


FC 

Configuration 

Task 

FCS 


Comments 


28 July 2003 (Autothrottle on for all runs) 
SOS I fs^ 



n/a 


n/a 


QGain 


PGain 


Saved data ok. DLL error identified 
and fixed. 


Pitch axis only. Update rate error 
identified and fixed. 


Roll axis only. No data. 


Pitch axis only. Pilot was more 
aggressive in 2 nd half of run. 


Checkout. 


Roll axis only. 


Pitch axis only. 


Roll axis only. 


29 July 2003 (Autothrottle on for all runs) 


Roll Doublet 


Pitch Doublet 


RIO 

C 

CHF 

Diagnostic 

n/a 

Rll 

C 

CHF 

Diagnostic 

n/a 

R12 

C 

CHF 

BACH 

PGain 

R13 

C 

CHF 

BACH 

RollTD 

R14 

C 

CHF 

BACH 

PLIM 

R15 

c 

CHF 

DT 

n/a 

R16 

C 

CHF 

DT 

PGain 

R17 

C 

CHF 

DT 

RollTD 

R18 

C 

CHF 

DT 

PLIM 

R19 

C 

CHF 

SOS 

PGain 

R20 

C 

CHF 

SOS 

PGain 

R21 

C 

CHF 

SOS 

PLIM 

R22 

C 

CHF 

SOS 

RollTD 

R23 

C 

CHF 

PACH 

QGain 

R24 

C 

CHF 

PACH 

PitchTC 

R25 

C 

CHF 

PACH 

PitchTD 

R26 

C 

CHF 

DT 

PitchTD 

R27 

C 

CHF 

DT 

PitchTD + 
RollTD 

R28 

C 

CLA 

BACH 

BGain + 
PGain 



Roll axis only, PGain=1.75 


Roll axis only, PGain=0 





































































































































Run# 

FC 

Configuration 

Task 

FCS 

Comments 

R29 

C 

CLA 

BACH 

BGain + 
PGain + 
RollTD 


R30 

c 

CLA 

DT 

BGain + 
PGain 


R31 

c 

CLA 

DT 

BGain + 
PGain + 
RollTD 


R32 

CM 

CLA 

BACH 

BGain + 
PGain 


R33 

CM 

CLA 

DT 

BGain + 
PGain 


R34 

CM 

CLA 

SOS 

BGain + 
PGain 


R35 

CM 

CLA 

w^m 

RollTD 

BGain=0.2, PGain=0 at start 

R36 

CM 

CLA 

PACH 

QGain 

Authothrottle disengaged 

R37 

CM 

CLA 

PACH 

QGain 


R38 

CM 

CLA 

PACH 

QGain 

PitchTD whole run, autothrottle 
disengage triggers sustained PIO 

R39 

C 

CLA 

Diagnostic 

n/a 

Pitch doublet, LOCATS timing test 
- strip charts only 

R40 

c 

CLA 

Diagnostic 

n/a 

Pitch doublet, LOCATS timing test 
- strip charts + FFT 

R41 

c 

CLA 

Diagnostic 

n/a 

Pitch doublet, LOCATS timing test 
- strip charts + FFT 

R42 

c 

CLA 

Diagnostic 

n/a 

Pitch doublet, LOCATS timing test 
- strip charts + FFT + TVTF 

R43 

c 

CLA 

Diagnostic 

n/a 

Pitch doublet, LOCATS timing test 
- strip charts + FFT + TVTF + 10 
persistent lines 

30 Ju 

ly 2003 (Autothrottle on for all runs) 

R50 

c 

CHF 

Diagnostic 

n/a 

Pitch Sweep 


R51 


CHF 


Diagnostic 


n/a 


Roll Sweep 


R52 


CLA 


Diagnostic 


n/a 


Roll Doublet 


R53 


CLA 


Diagnostic 


n/a 


Roll Sweep 


R54 


CLA 


Diagnostic 


n/a 


Pitch Doublet 


R55 


CLA 


Diagnostic 


n/a 


Pitch Sweep 


R56 


R57 


CLA 


CLA 


BACH 


BACH 


BGain + 
PGain 


RollTD whole run 
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BGain + 
PGain 


RollTT) whole run, extra aggressive 
pilot technique 



























































































































Run# 

FC 

Configuration 

Task 

FCS 

Comments 

R58 

C 

CLA 

DT 

QGain 

PitehTD + RollTD whole run, mild 
PIO after failure 

R59 

c 

CLA 

DT 

QGain + 
PGain 

PitehTD + RollTD whole run 

R60 

CM 

CLA 

Diagnostic 

n/a 

Wavelet test, 8192 pts, some 
computational slow down 

R61 

CM 

CLA 

Diagnostic 

n/a 

Wavelet test, 4096 pts, no 
computational slow down 

R62 

CM 

CLA 

Diagnostic 

n/a 

Wavelet test, 6144 pts, no 
computational slow down 

R63 

CM 

CLA 

Diagnostic 

n/a 

Wavelet + FFT test, no 
computational slow down 

R64 

CM 

CLA 

BACH 

BGain + 
PGain 


R65 

CM 

CLA 

BACH 

BGain + 
PGain 

20 degree captures, extra aggressive 

R66 

CM 

CLA 

BACH 

BGain + 
PGain 

RollTD whole run 

R67 

CM 

CLA 

BACH 

BGain + 
PGain 

RollTD whole run, extra aggressive, 
mild PIO 

R68 

CM 

CLA 

PACH 

n/a 

No change 

R69 

CM 

CLA 

PACH 

QGain 

PitehTD whole run, PIO 

R70 

CM 

CLA 

DT 

QGain + 
BGain + 
PGain 

Mild pitch PIO 

R71 

CM 

CLA 

DT 

QGain + 
BGain + 
PGain 

PitehTD and RollTD whole run, 
pitch PIO 

R72 

A 

ALA 

Diagnostic 

n/a 

Roll Doublet 

R73 

A 

ALA 

Diagnostic 

n/a 

Roll Doublet repeat 

R74 

A 

ALA 

Diagnostic 

n/a 

Roll Sweep 

R75 

A 

ALA 

Diagnostic 

n/a 

Pitch Doublet 

R76 

A 

ALA 

Diagnostic 

n/a 

Pitch Sweep 

R77 

A 

ALA 

BACH 

n/a 


R78 

A 

ALA 

BACH 

BGain + 
PGain 


R79 

A 

ALA 

BACH 

BGain + 
PGain 

RollTD whole run, Large overshoots 

R80 

AX 

ALA 

BACH 

n/a 


R81 

AX 

ALA 

BACH 

BGain + 
PGain 
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FCS 


Comments 


Run# 

FC 

Configuration 

Task 


R82 

AX 

ALA 

BACH 

BGain + 

RollTD whole run, mild PIO 





PGain 



31 July 2003 


R90 

C 

CLA 

Diagnostic 

n/a 

Pitch Doublet, autothrottle off 

R91 

C 

CLA 

Diagnostic 

n/a 

Pitch Sweep, autothrottle off 

R92 

CM 

CLA 

PACH 

QGain 

Autothrottle on 

R93 

CM 

CLA 

PACH 

QGain 

Autothrottle off Runs 93-106 

R94 

cm" 

CLA 

PACH 

QGain 

PitchTD whole run, significant PIO 

R95 

CM 

CLA 

PACH 

QUM 

PIO after failure 

R96 

CM 

CLA 

PACH 

QLIM 

PitchTD whole run, some PIO 

R97 

CM 

CLA 

SOS 

QGain 


R98 

CM 

CLA 

SOS 

QGain 

PitchTD whole run, more 
oscillatory, no real PIO 

R99 

CM 

CLA 

DT 

QGain 

Mild PIO 

R100 

CM 

CLA 

DT 

QGain 

PitchTD whole run, large overshoot 
following failure, mild PIO 

R101 

C 

CLA 

Diagnostic 

n/a 

Roll Doublet 

R102 

c 

CLA 

Diagnostic 

n/a 

Roll Sweep 

R103 

CM 

CLA 

BACH 

PGain 

Not a problem for pilot 

R104 

CM 

CLA 

BACH 

BGain + 
PGain 


R105 

CM 

CLA 

BACH 

BGain + 
PGain 

RollTD whole run, large overshoots, 
mild PIO 

R106 

CM 

CLA 

DT 

QGain + 
BGain + 
PGain 

PitchTD and RollTD whole run, 
multi-axis failures 

R107 

CH 

CLA 

Diagnostic 


Pitch Doublet, autothrottle on Runs 
107-110 

R108 

CH 

CLA 

Diagnostic 


Pitch Sweep 

R109 

CH 

CLA 

Diagnostic 


Roll Doublet 

R110 

CH 

CLA 

Diagnostic 


Roll Sweep 

Rill 

CH 

CLA 

Diagnostic 

n/a 

Pitch Doublet, autothrottle off Runs 
111-128 

R112 

CH 

CLA 

Diagnostic 

n/a 

Pitch Sweep 

R113 

CH 

CLA 

Diagnostic 

n/a 

Roll Doublet 

R114 

CH 

CLA 

Diagnostic 

n/a 

Roll Sweep 

R115 

CH 

CLA 

PACH 

QGain 


R116 

CH 

CLA 

PACH 

QGain 

PitchTD whole run, PIO 
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Ran# 

FC 


Task 

FCS 

Comments 

R117 

CH 

CLA 

PACH 

QLIM 

PitchTD whole run, PIO 

R118 

CH 

CLA 

SOS 

n/a 

Pitch axis only 

R119 

CH 

cLa 

SOS 

QGain 

Pitch axis only, PitchTD whole run, 
PIO 

R120 

CH 

CLA 

BACH 

PGain 


R121 

CH 

CLA 

BACH 

BGain + 
PGain 


R122 

CH 

CLA 

BACH 

BGain + 
PGain 

RollTD whole run, mild PIO in 
middle or run 

R123 

CH 

CLA 

SOS 

n/a 

Roll axis only 

R124 

CH 

CLA 

SOS 

BGain + 
PGain 

Roll axis only, RollTD whole run, 
sustained oscillations 

R125 

CH 

CLA 

DT 

BGain + 
PGain 

Some PIO 

R126 

CH 

CLA 

DT 

QGain 

Data lost 

R127 

CH 

CLA 

DT 

QGain 

PitchTD and RollTD whole run, 
pitch PIO 



CLA 

DT 

BGain + 
PGain 

PitchTD and RollTD whole run, 
oscillatory, roll PIO 


1 August 2003 


R130 

C 

CLA 

Diagnostic 

n/a 

Pitch doublet, autothrottle off Runs 
130-134, QGain=0 

R131 

C 

CLA 

Diagnostic 

n/a 

Repeat of R130, extended time 

R132 

C 

CLA 

Diagnostic 

n/a 

Pitch Sweep, QGain=0 

R133 

C 

CLA 

Diagnostic 

n/a 

Roll Doublet, PGain=0 

R134 

C 

CLA 

Diagnostic 

n/a 

Roll Sweep, PGain=0 


C 

CLA 

Diagnostic 

n/a 

Throttle Sweep with autopilot 

R136 

C 

CLA 

Diagnostic 

n/a 

Throttle Sweep with autopilot off 

R137 

C 

CLA 

PACH 

QGain 

PitchTD from start 




































































































43 Diagnostic Maneuvers 

4.3. 1 Pilot Control Stick Characteristics 

The CLA (autothrottle on) frequency sweep runs were used to identify the dynamic characteristics of the 
simulator’s control stick. Coinciding with comments made by the evaluation pilot, it was found that the 
pitch stick characteristics were essentially linear, while the roll stick characteristics were modified by 
common control system nonlinearities. Details are provided below. 

4.3.1. 1 Pitch Stick 

The pitch stick characteristics were identified from R55. Partial stick force and position time histories are 
shown in Figure 15 for the first 20 seconds of the frequency sweep. Here, the slowly increasing 
frequency sinusoidal stick force input is matched by a sinusoidal stick position output. No significant 
nonlinear characteristics are evident in the responses. The Figure 16 frequency response was generated 
using the fast Fourier transform (FFT) tools included in the STI Matlab-based wavelet toolbox. Note the 
excellent coherence from 0.3 rad/sec to nearly 30 rad/sec and the apparent second order response within 
this range. From this observed characteristic a second order transfer function fit was made to the 
frequency response as shown in Figure 17. Although the control stick dynamics are in most cases 
represented by a second order response, the result here indicates a lower than anticipated breakpoint 
frequency (i.e., 13.5 rad/sec) that will have a significant phase lag contribution to the overall aircraft to 
stick force response. 

4.3. 1.2 Roll Stick 

The roll stick characteristics were identified from R33. Partial stick force and position time histories are 
shown in Figure 18 for the first 20 seconds of the frequency sweep. In this case, the slowly increasing 
frequency sinusoidal stick force input is not matched by a sinusoidal stick position output. By reviewing 
the characteristics of common flight control system nonlinearities as defined in Ref. 13, hysteresis is 
observed in the “flattened” response as the stick position output crosses zero, and some additional 
nonlinearity is producing a “clipped” response at the peak output amplitudes. Ignoring these observed 
nonlinearities at first, the Figure 19 frequency response was generated. The coherence was, generally 
speaking, good in the frequency range of interest, but this measure of the linear correlation between the 
input and outputs signals is clearly not as good as that seen in Figure 16 for the pitch stick. A 
predominately second order response is again observed and the resulting fit is shown in Figure 20. Here a 
second order fit matches the amplitude response well, but there is a nearly constant phase offset 
throughout the frequency range of interest. 

To explain the phase mismatch of Figure 20, the nonlinear characteristics were investigated further, 
beginning with the cross plot of stick position to stick force as shown in Figure 21. This plot was 
generated using the nearly 90 seconds of essentially constant amplitude stick force and position responses 
of R53. Here, the common preload plus friction response is clearly revealed. An idealized response 
represented by the thick, gray line indicates that the characteristic is not quite symmetric. By estimating 
the 2b and F s parameters from Figure 21, the negative inverse describing function for this nonlinearity 
(see Figure 22, revised from Ref. 14) is used to estimate the added phase lag resulting from the 
nonlinearities. In this case the resulting phase lag is in the neighborhood of 20 degrees (the “noisy” data 
of Figure 21 prevents a more accurate estimation). Finally, the transfer function fit is adjusted to account 
for this added phase lag, the result of which is shown in Figure 23. When accounting for the nonlinearity 
there is also a resulting gain attenuation. This adjustment in gain was accounted for in the linear fit, so no 
further adjustment was required. Because the effects of this nonlinearity are sensitive to changes in input 
amplitude, a unique fit is not possible. As with the pitch stick characteristics, the relatively low 
breakpoint frequency (i.e., 16 rad/sec) will also have a significant phase lag contribution to the overall 
aircraft to stick force response. 
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Figure 18. Partial Roll Stick Force and Position Time Histories from R53 Frequency Sweep 



Figure 19. Run 53 CLA DLAT/FLAT Frequency Response 
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Figure 20. Transfer Function Fit to Roll Stick Frequency Response 
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Figure 23. Revised Transfer Function Fit to Roll Stick Frequency Response 
(20 degrees of added phase lag due to friction plus preload nonlinearity) 
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4.3.2 Configuration Frequency Responses and Airplane Bandwidth Assessments 

As identified in Table 12 diagnostic maneuvers consisting of pitch and roll axis frequency sweeps and 
pitch and roll axis doublets were completed for each aircraft configuration flown as part of the LOCATS 
formal assessment. Attitude to stick force frequency response Bode plots were generated from the 
frequency sweep runs using the fast Fourier transform techniques included in the Matlab version of the 
STI wavelet analysis toolbox. Included with these plots was the corresponding coherence, a measure of 
how well the input and output signals are linearly correlated. It is desirable to have coherence values 
above 0.66 in terms of confidence in the resulting transfer function correlation. 

The resulting plots were then used to obtain airplane bandwidth parameters, as defined in Volume I of this 
report, for each configuration. In the analysis described herein, results were not accepted for runs where 
the coherence fell below this threshold in the critical frequency region where the bandwidth measures are 
made. 

4.3.2. 1 Longitudinal Configurations 

As indicated in Table 13, the baseline longitudinal aircraft configurations from which flight control 
system failures were introduced were flown with and without the autothrottle. An additional frequency 
sweep run was also made for the failed pitch rate feedback case, the most commonly introduced 
longitudinal flight control system failure. Time histories and corresponding frequency response plots 
from the frequency sweep runs were generated for each configuration. Each set of time histories includes 
longitudinal stick force (FLON) and position (DLON), elevator command (DEC), averaged elevator 
position (DE), pitch rate (Q), and pitch attitude (THE). Note that for all cases the pilot was able to 
maintain a nearly constant stick force amplitude until the highest frequencies. The computed frequency 
responses include a Bode magnitude and phase plot and the corresponding coherence measure. 

Airplane bandwidth parameters were computed for each pitch attitude to stick force (THE/FLON) 
frequency response. The results are tabulated in Table 13. The actual bandwidth frequency is the lowest 
of the phase and gain bandwidth values. Note that for all of the configurations, the bandwidth frequency 
results from the gain value. In terms of pitch tracking handling qualities, the configurations have a Level 
2 bandwidth frequency. When the phase delay, a measure of the high frequency phase roll off, is taken 
into consideration, only the augmented autothrottle off configurations (R91 and R112) remain in the 
Level 2 region. The increased augmentation associated with the autothrottle on runs produce over 100 
msec of additional phase delay. 


Table 13. Pitch Axis (THE/FLON) Airplane Bandwidth Parameters 


Run 

Configuration 

Time Series/ 
Freq. Response 

Phase CObw 
(rad/sec) 

Gain GObw 
(rad/sec) 

W. 180 * 

(rad/sec) 

tp 

(sec) 

R50 

CHF 

(autothrottle on) 

Figure 24 & 
Figure 25 

3.340 

1.409 

5.127 

0.332 

R55 

CLA 

(autothrottle on) 

Figure 26 & 
Figure 27 

3.186 

2.036 

4.925 

0.314 

R91 

CLA 

(autothrottle off) 

Figure 28 & 
Figure 29 

2.925 

2.005 

4.515 

0.192 

R112 

CHLA 

(autothrottle off) 

Figure 30 & 
Figure 31 

1.758 

1.439 

3.740 

0.170 

R132 

CLA, QGain = 0 
(autothrottle off) 

Figure 32 & 
Figure 33 

1.697 

1.523 

2.094 

0.231 
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All of the configurations suffer from large phase delay values, regardless of the effect of the autothrottle. 
The control stick analysis detailed in the previous section identified one source of the significant phase 
delay. In pitch the control stick transfer function is characterized by a 2 nd order mode at 13.5 rad/sec. To 
investigate the impact of this effective command path lag, a pitch attitude to stick position (THE/DLON) 
frequency response was generated for comparison (see Figure 34). In this case the computed bandwidth 
parameters yield a phase delay of 0.232 sec, 100 msec lower than the phase delay produced from the 
corresponding THE/FLON frequency response. A 60 msec reduction in phase delay was achieved with 
the R91 autothrottle off case. There were not enough data runs available to fully investigate why this 
value is not the same as the autothrottle on case, but nonetheless the added phase delay from the stick is 
significant. 

4.3.2.2 Lateral Configurations 

Frequency sweeps runs were generated for each of the baseline lateral aircraft configurations from which 
flight control system failures were introduced. An additional frequency sweep run was also made for the 
failed roll rate feedback case, the most commonly introduced lateral flight control system failure. Time 
histories and corresponding frequency response plots from frequency sweep runs were generated for each 
configuration. Because of the impact of the preload/hysteresis nonlinearity described in the previous 
section, poor coherence resulted from sweeps in which the pilot’s input amplitude did not exceed the 
force threshold, thus rendering a number of diagnostic runs unusable. Each set of time histories includes 
lateral stick force (FLAT) and position (DLAT), aileron command (DAC), aileron position (DA), roll rate 
(P), and roll attitude (PHI). As with the longitudinal configurations the pilot was able to maintain a 
nearly constant stick force amplitude until the highest frequencies. Once again the computed frequency 
responses include a Bode magnitude and phase plot and the corresponding coherence measure. 

Computed bandwidth parameters are provided in Table 14 for those runs that produced high coherence 
data. For these configurations the gain and phase bandwidths were close in value with the phase 
bandwidth being lower in two of the three cases. The phase delay values were also similar in value. As 
would be expected, no phase delay effect from the longitudinal axis autothrottle augmentation is observed 
in the lateral axis. In terms of roll tracking handling qualities, the configurations have a Level 1 
bandwidth frequency, however the high phase delay values move the configurations into the Level 3 
region. In addition to the significant nonlinearities, the analysis of the lateral stick dynamics yielded a 2 nd 
order pole at 16 rad/sec. A frequency response of roll attitude to stick position was generated for the R51 
frequency sweep (see Figure 41). The resulting phase delay was in this case 0.178 sec, 80 msec less than 
the value for PHI/FLAT shown in Table 14. Thus, a significant portion of the phase delay comes from the 
stick dynamics. 


Table 14. Roll Axis (PHI/FLAT) Airplane Bandwidth Parameters 


Ron 

Configuration 

Time Series/ 
Freq. Response 

Phase cobw 
( rad/sec) 

Gain cob w 
( rad/sec) 

< 0 - 180 " 

(rad/sec) 

T P 

(sec) 

R51 

CHF 

(autothrottle on) 

Figure 35 & 
Figure 36 

1.04 

1.14 

1.74 

0.259 

R53 

CLA 

(autothrottle on) 

Figure 37 & 
Figure 38 

1.416 

1.356 

2.039 

0.247 

R102 

CLA 

(autothrottle off) 

Figure 39 & 
Figure 40 

low coherence 
data 

1.019 

1.708 

6.274 
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Figure 25. Run 50 CHF THEVFLON Frequency Response (Autothrottle On) 
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Figure 27. Run 55 CLA THE/FLON Frequency Response (Autothrottle On) 
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Figure 29. Run 91 CLA THE/FLON Frequency Response (Autothrottle Off) 
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Figure 34. Run 50 CHF THE/DLON Frequency Response (Autothrottle On) 
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Figure 36. Run 51 CHF PHI/FLAT Frequency Response (Autothrottle On) 
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Figure 38. Run 53 CLA PHI/FLAT Frequency Response (Autothrottle On) 
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Figure 40. Run 102 CLA PHI/FLAT (Autothrottle Of!) 
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Figure 41. Run 51 CHA PHI/DLAT Frequency Response (Autothrottle On) 
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4.4 Bank Angle Capture and Hold Evaluations 

A listing of the key bank angle capture and hold evaluation runs is provided in Table 15. Time histories 
and time varying transfer function (TVTF) and wavelet eigen value realization (WERA) analysis plots for 
the Table 15 runs are provided in Figure 42 through Figure 65. 


Table 15. Selected BACH Evaluation Runs 


Run# 

FC 

Configuration 

Task 

FCS 

Comments 

No PIO Runs 

R77 

A 

ALA 

BACH 

n/a 


R80 

AX 

ALA 

BACH 

n/a 


R120 

CH 

CLA 

BACH 

PGain 


Mild PIO Runs 

R28 

C 

CLA 

BACH 

BGain + 
PGain 

Mild, damped oscillations 

R79 

A 

ALA 

BACH 

BGain + 
PGain 

RollTD whole run, Large overshoots 

R122 

CH 

CLA 

BACH 

BGain + 
PGain 

RollTD whole ran, mild PIO in 
middle or ran 

Sustained or Severe PIO Runs 

R29 

C 

CLA 

BACH 

BGain + 
PGain + 
RollTD 

Large overshoots follow failure and 
lead to PIO, oscillations damp out 

R82 

AX 

ALA 

BACH 

BGain + 
PGain 

RollTD whole run, mild PIO 
transitions to severe, sustained 
oscillations 
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Figure 43. R77 TVTF Analysis 
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Figure 47. R80 WERA Analysis 
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Figure 52. R28 TVTF Analysis 
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Figure 55. R79 TVTF Analysis 
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Figure 58. R122 TVTF Analysis 
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Figure 64. R82 TVTF Analysis 
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Figure 65. R82 WERA Analysis 


TR 1341-2 


89 


4.5 Pitch Attitude Capture and Hold Evaluations 

A listing of the key pitch attitude capture and hold evaluation runs is provided in Table 16. Time 
histories and time varying transfer function (TVTF) and wavelet eigen value realization (WERA) analysis 
plots for the Table 16 runs are provided in Figure 66 through Figure 92. 

Table 16. Selected PACH Evaluation Runs 


Run# 

FC 

Configuration 

Task 

FCS 

Comments 

No PIO Runs 

R68 

CM 

CLA 

PACH 

n/a 

No change 

Mild PIO Runs 


CM 

CLA 

PACH 

QLIM 

Oscillations after failure 

R96 

CM 

CLA 

PACH 

QLIM 

PitchTD whole run, some PIO 

R115 

CH 

CLA 

PACH 

QGain 

Three cycle PIO following failure 

R117 

CH 

CLA 

PACH 

QLIM 

PitchTD whole run, small amplitude 
but sustained PIO 

Sustained or Severe PIO Runs 

R38 

CM 

CLA 

PACH 

QGain 

PitchTD from start, autothrottle 
disengage triggers sustained PIO 

R69 

CM 

CLA 

PACH 

QGain 

PitchTD whole run, PIO 

mn 

CM 

CLA 

PACH 

QGain 

PitchTD whole run, significant PIO 
after failure 

£ 

CH 

CLA 

PACH 

QGain 

PitchTD whole run, PIO 
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b) 21 Point Time Averaging 
Figure 67. R68 TVTF Analysis 
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Figure 70. R95 TVTF Analysis 
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Figure 73. R96 TVTF Analysis 
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Figure 75. R115 Time Histories, MOd PIO 
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Figure 79. R117 TVTF Analysis 
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Figure 80. R117 WERA Analysis 
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Figure 83. R38 WERA Analysis 
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Figure 85. R69 TVTF Analysis 
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Figure 88. R94 TVTF Analysis 
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Figure 89. R94 WERA Analysis 


TR 1341-2 


114 











Bandwidth [r«d/«*c| 


- 50 60 

Nc) 

a) 41 Point Time Averaging 



lime {sec] 
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Figure 91. R116 TVTF Analysis 
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4.6 Sum-of-Sines Tracking Evaluation Runs 

A listing of the sum-of-sines tracking evaluation runs is provided in Table 17. Time histories and time 
varying transfer function (TVTF) and wavelet eigen value realization (WERA) analysis plots for the 
Table 17 runs are provided in Figure 93 through Figure 104. 


Table 17. Selected SOS Evaluation Runs 


Run# 

FC 

Configuration 

Task 

FCS 

Comments 

No PIO Runs 

R118 

CH 

CLA 

SOS 

n/a 

Pitch axis only 

R123 

CH 

CLA 

SOS 

n/a 

Roll axis only 

Sustained or Severe PIO Runs 

R119 

CH 

CLA 

SOS 

QGain 

Pitch axis only, PitchTD whole run, 
sustained PIO follows failure 

R124 

CH 

CLA 

SOS 

BGain + 
PGain 

Roll axis only, RollTD whole run, 
sustained oscillations 
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Figure 97. R123 TVTF Analysis 
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Figure 100. R119 TVTF Analysis 
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Figure 103. R124 TVTF Analysis 
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Figure 104. R124 WERA Analysis 
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4.7 Discrete Tracking Task Evaluations 

A listing of the discrete tracking evaluation runs is provided in Table 18. Time histories and time varying 
transfer function (TVTF) and wavelet eigen value realization (WERA) analysis plots for the Table 18 
runs are provided in Figure 105 through Figure 128. 


Table 18. Selected DT Evaluation Runs 


Run# 

FC 

Configuration 

Task 

LOC 

Comments 

No PIO Runs 

R15 

C 

CHF 

DT 

n/a 


R18 

C 

CHF 

DT 

PUM 


Mild PIO Runs 

R70 

CM 

CLA 

DT 

QGain + 
BGain + 
PGain 

Mild pitch PIO 

R71 

CM 

CLA 

DT 

QGain + 
BGain + 
PGain 

PitchTD and RollTD whole run, 
pitch PIO 

R99 

CM 

CLA 

DT 

QGain 

Mild pitch PIO 

R100 

CM 

CLA 

DT 

QGain 

PitchTD whole run, large overshoot 
following failure, mild PIO 

R106 

CM 

CLA 

DT 

QGain + 
BGain + 
PGain 

PitchTD and RollTD whole run, 
multi-axis failures 

Sustained or Severe PIO Runs 

R128 

CH 

CLA 

DT 

BGain + 
PGain 

PitchTD and RollTD whole run, 
sustained roll PIO 
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Figure 106. R15 TVTF Analysis 
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Figure 109. R18 TVTF Analysis 
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Figure 112. R70 TVTF Analysis 
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Figure 113. R7I 
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Figure 115. R71 TVTF Analysis 
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Figure 118. R99 TVTF Analysis 
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Figure 121. R100 TVTF Analysis 
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Figure 124. R106 TVTF Analysis 
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Figure 127. R128 TVTF Analysis 
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1. INTRODUCTION 


This three volume report documents the results of a Phase II Small Business Innovation Research (SBIR) 
contract to develop an on-line means to predict aircraft loss of control using wavelets. Systems 
Technology, Inc. (STI) conducted the work for NASA Dryden Flight Research Center at Edwards, CA. 
The overall objective of this proposed program was to apply wavelet technology in the form of a Loss of 
Control Analysis Tool Set or LOCATS as a means of predicting loss of control for the broad range of 
refractory automatic and manual control system problems. These control problems are those that escape 
detection by typical design criteria and methodologies, surface under unusual or rare circumstances, and 
threaten flight safety. Specific Phase H technical objectives were as follows: 

• Extend the capabilities of the LOCATS to include improved wavelet formulations for 
real-time applications with validity measures; 

• Identify time varying pilot-vehicle system characteristics that can be an indicator of 
impending loss of control; 

• Identify, develop and validate wavelet-based time varying metrics to predict loss of 
control of automatic and manual flight control systems and to monitor overall flight 
control system health; 

• Develop software and/or hardware solutions for the implementation of the real-time 
LOCATS; 

• Provide a graphical user interface, real-time graphics displays, and networking 
capabilities for the prototype real-time LOCATS; and 

• Evaluate the prototype real-time LOCATS in a piloted simulation that features flight 
control system software and hardware representative of current state-of-the-art 
aircraft. 

The evaluation of the prototype LOCATS was conducted using the flight control system hardware-in-the- 
loop simulator facility of BAE SYSTEMS Platform Solutions Sector (here after referred to as BAE 
SYSTEMS) of Johnson City, NY. 

Volume I of this report begins with an overview of issues involving aircraft loss of control. This is 
followed by a description of the LOCATS software, detailed development of the wavelet-based loss of 
control detection techniques, and a discussion of the results from the LOCATS piloted simulation 
evaluation. Supporting material is provided in the appendices. Volume II of this report provides the 
LOCATS piloted simulation test plan and detailed descriptions of the simulation checkout and formal 
evaluation. Finally, Volume HI of this report contains the LOCATS User’s Guide. 
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2. GETTING STARTED 

The LOCATS software has the following parts: 

Data collection: Real time data transfer from the Mil 1553 data bus or pseudo real time playback 
from ASCII files. 

Configuration management: Selection of data source and selection of plots. 

Displays: Real time graphical displays of time series and transforms. 

Wavelet and FFT Transforms: Calculations for power spectra, transfer functions, and stability 
parameters. 

This user’s guide explains the operation of the program for each of these parts. 

The software runs in a Windows operating system (Win98, Win2000, or WinXP). The visual and data 
collection parts of the program are written in Visual Basic, and the 
transform calculations are written in C and contained in a dynamic 
link library or DLL. The program is available either as a compiled 
program, or it can be run inside of the Visual Basic development 
environment. The latter is more flexible for making changes, but 
requires some knowledge of the software. The program is started 
from an icon, located on the start menu, the desktop, or in the 
explorer. The icon in Figure 1 is the default for a Visual Basic 
Program. 

Install the program using a standard Windows install shield, which 
loads the executable file, various DLL files that contain support 
software, data files collected on the BAE SYSTEMS simulator, and sample configuration files. The real 
time data transfer is specific to the SBS Technologies Mil 1553 data bus card used to read signals from 
the BAE SYSTEMS simulator, and changes to the software and perhaps new hardware will be required to 
support other data interfaces. Start the program, the splash screen in Figure 2 will be displayed for a few 
seconds, and then you are ready for configuration management. 




Figure 2. LOCATS Splash Screen 
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3. DATA COLLECTION 


3.1 Real Time 

The real time signals are read from the Mil 1553 bus. The signal names, scale factors, and bus locations 
are stored in an ASCII file with file type “sig.” A sample is shown in Figure 3. 

20000 

Q, 5 . 49316E- 03,-180,180,12,21,13,1, Pitch Rate (deg/sec) 

VCAS, 3. 12S0E- 02, -1024, 1024, 12, 1,4,1, Calibrated Airspeed (kt) 

AZ , 3 . 1250E- 02 , - 1024 , 1024 , 12 , 4 , 30 , 1 , Vertical Acceleration (f t/sec *2 ) 

THE, 5. 49E-03, -90, 90,25,2,11, 1, Pitch Attitude (deg) 

PHI ,1.2207E-04,-4,4,12,17,25,1, Roll Attitude (rad) 

P,5.4932E-03, -180,180,12,22, 11, 1, Roll Rate (deg/sec) 

Figure 3. Example .sig File 

The .sig file is read by LOCATS. The file format is defined as follows: 

First line is max # data points that will be collected. 

Each additional line defines a signal. Using the first signal as an example: 

Q = name of signal that appears in dialog boxes and on plots 
5.493 16E-03 = scale factor that multiplies data received from the bus. 

-180 = minimum value, initial value used by dialog box 
180 = maximum value, initial value used in dialog box 

12 = Mil 1553 address for this signal (RT Address) 

21 = Mil 1553 address for this signal (Sub Address) 

13 = Mil 1553 address for this signal (Data word within sub address) 

1 = BAE SYSTEMS simulator bus number 

Pitch Rate (deg/sec) = detailed description of signal (not used in LOCATS) 

For remaining details please see the documentation for the Mil 1553 bus. The LOCATS code that reads 
and interprets the Mil 1553 bus is unique to the experimental setup used at BAE SYSTEMS and will 
likely have to be modified for a different site. 

3.2 Recorded Data 

Data stored in ASCII files can be loaded and then played back in pseudo-real time (never faster, 
sometimes slower). Part of a data file is shown in Figure 4. The file structure is defined by: 

Header on first 3 lines can contain any information and is ignored. 

Fourth line has signal names, 9 characters per name with blank fill. 

Data begins on fifth line, one number per signal separated by blanks. 

The “File/Load Data” menu item and the “R2D2” toolbar icon loads the recorded data. 

The “File/Save Data” menu item saves recorded real time data in this format. 
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LoCats Build 1.00.01 
Real-Time data collected 
July 30, 2003 2:26 PM 


Time Q 

0 . 0000000e+000 
2. 0000 87 Oe -002 
4 . 0002290e-002 
6.0005670e-002 
8 . 0006820e-002 
1.0000 910e-001 
1. 200119 Oe -001 
1. 400 14 2 Oe -001 
1.6001560e-001 
1 . 8001900e-001 
2 . 0002070e-001 
2 . 2002210e-001 
2 . 4002440e-001 
2 . 6002720e-001 
2 . 8002940e-001 
3 . 0003170e-001 
3 . 20 0334 Oe- 001 
3.4003570e-001 


VCAS AZ 
2 . 7465800e-001 
2 . 7465800e-001 
2 . 9663060e-001 
2 . 9663060e-001 
3 . 0761690e- 001 
3 . 0761690e-001 
3 . 1311010e- 001 
3 . 1311010e- 001 
3 . 0761690e-001 
3 . 0761690e- 001 
2 . 9663060e-001 
2 . 9663060e- 001 
2 . 8015120e-001 
2 . 8015120e-001 
2 . 4719220e- 001 
2 . 4719220e- 001 
2 . 0324690e-001 
2 .0324690e-001 


THE PHI 
2 . 6825000e+002 
2 . 6825000e+002 
2 . 6825000e+002 
2 . 682 500 0e+ 002 
2 . 6828 130e+ 002 
2.6828130e+002 
2 . 682813 0e+002 
2. 682813 0e+002 
2 . 6843750e+002 
2 . 6843750e+002 
2 .6843750e+002 
2.6843750e+002 
2.6828130e+002 
2. 682813 0e+002 
2 . 6828130e+002 
2 .6828130e+002 
2 . 6787500e+002 
2 . 6787500e+002 


P VT R 

3 . 1250000e-001 -7 . 2468000e-001 
3 . 1250000e-001 -7 . 1919000e-001 
3 . 1250000e-001 -7 . 1370000e- 001 
1 . 8125000e+000 -7 . 0821000e- 001 
1 . 8125000e+000 -7 . 0272000e- 001 
1 . 8125000e+000 -6 . 9723000e- 001 
1 . 8125000e+000 -6 . 8076000e-001 
2 . 5000000e+000 -6 . 8076000e- 001 
2 . 5000000e+000 -6 . 7527000e-001 
2 . 5000000e+000 -6 . 6978000e-001 
2 . 5000000e+000 -6 . 6429000e- 001 
1.4687500e+000 -6 . 5880000e-001 
1 . 4687500e+000 -6 . 5331000e-001 
1 . 4687500e+000 -6 . 4782000e- 001 
1 . 4687500e+000 -6 .4233000e-001 
7 . 8125000e-001 -6 . 3684000e-001 
7 . 8125000e-001 -6 . 3135000e-001 
7 . 8125000e-001 -6 . 2586000e- 001 


Figure 4. .dat Data File 


TPSI ALPHA 

-4. 882800 Oe -003 
-4. 882800 Oe -003 
-4.8828000e-003 
-4. 882800 Oe -003 
-4. 882800 Oe -003 
-5. 371080 Oe -003 
-5. 371080 Oe -003 
-5. 371080 Oe -003 
-5. 37 10 80 Oe -003 
-5. 371080 Oe -003 
-5.3710800e-003 
-5. 371080 Oe -003 
-5. 371080 Oe -003 
-5. 371080 Oe -003 
-5. 371080 Oe -003 
-5. 371080 Oe -003 
-5. 371080 Oe -003 
-5. 371080 Oe -003 
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4. CONFIGURATION MANAGEMENT 


4.1 The Main Screen 

Start the program and the main screen shown in Figure 5 will appear. The main screen has the follow 
parts: 


Menu bar: File operations. There is currently no on-line help. 

Tool bar: Most of the operations are started from the toolbar: 

Iconl (Save): Save collected data. Enabled for real time operations. 

Icon2 (Tools): Configuration options. Not currently used. 

Icon3 (R2D2): Load data from file. 

Icon4 (6-Plot): Add new plots. Creates a new branch in the Active Plots panel. 

Icon5 (Jet): Begin data collection. Pops up the active plots. 

Icon6 (Pause): Pause playback. 

Icon7 (Stop): Stop data collection. 

Icon8 (Plot): Plot existing data. Brings back plots after stopping. 

System Information: The panel on the left hand side is a record of operations, including error 
messages. 

Active Plot Tree: The panel on the right hand side defines the real time plots. Change signals and 
options by clicking on a branch. 


aiaro 


m * at mtsmmm * w^mm ■ 



Figure 5. LOCATS Main Screen 
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4.2 Active Plots 

The objective of this user’s guide is for you to be able to create sets of active plots such as those shown in 
Figure 6. To play back stored data and duplicate these plots: 

Start the program. 

Use “File/Load Configuration” and select “pitch l.cfg” located in the “BAE Data” directory. 

Click “R2D2” and open “Run69.dat” located in the same directory. 

Click the Jet icon. 

View the plots in real time. 

Position 

Drag the plots to the desired positions. The positions are remembered when the configuration is recalled. 
The plots always stay on top. 

Timing 

When running in real time the transform calculations and/or plotting routines can take longer than a cycle 
time, in which case data during the missed cycles is lost. See Timing in Section 6.10 for further 
information. 

When playing back recorded data the program delays during each cycle if time remains so that the data is 
not played back faster than real time. If the transform and/or plotting routines take longer than a cycle the 
data is not skipped and the playback occurs slower than real time - hence in pseudo-real time. 



Figure 6. Active Plots 


TR 1341-3 


6 


4.3 File Menu 

Use the File menu to open the three types of files used by LOCATS: 

.cfg = configuration files (information about the plots to be created) 

.dat = data files (ASCII files with data for playback in pseudo-real time ) 

.sig = signal files (information about the real time signals) 

The File menu and the open dialog boxes are shown in Figure 7. 

Configuration Files 

The configuration files can be saved using “Save configuration ” or the current configuration cleared 
using “New configuration.” The program starts by loading the previous configuration file (but not the 
previous data file or signal file). The user is prompted to save the current configuration when quitting if 
changes have been made. The program can “crash” on start-up if out-of-date versions of the configuration 
files are used, in which case the out-of-date versions should be deleted. 

Data Files 

Previously stored data is loaded using “Load data.” The “R2D2” toolbar icon does the same thing. Real 
time data just collected is stored using “Save data.” 
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Figure 7. File Menu and Open Dialog Boxes 
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4.4 Add New Plots 

Click the 6-Plot toolbar icon to add a new plot. The following plots are available: 

Strip charts: Signals versus time. Up to 4 subplots (also known as channels). Each subplot can 
be multiple signals. Automatically scrolls. 

XY Plot: Any two signals plotted versus each other. Does not scroll. 

Scatter Plot: Like an XY plot, but with dots. 

Estimated PSD: Computes and plots the power spectra of the selected signals. Up to 4 subplots, 
each with one or more signals. 

Estimate TF: Computes and plots the transfer function of selected pairs of signals. Only one pair 
of signals, but up to 4 subplots, containing magnitude, phase, coherence, and so on. 

The new plots appear in the active plot tree. Click on the branches to select signals and parameters. 








4.5 Plot Information 

Click on a plot title in the active plot tree and the Plot Information dialog box pops up. 

Title: The plot title is automatically created when signals are selected. Change the title in the edit 
box and click Ok. (The new title may be lost if other options are selected, so immediately save the 
title). 

Display: The plots on the active plot tree are not displayed unless the “Display Plot” checkbox is 
checked. 

# Channels: Each plot can have up to four channels. The active plot tree has a sub-branch for 
time or frequency and then a sub-branch for each channel. 

Order: Use the up and down arrows to change the order of the plots on the active plot tree. 
Delete: Delete the plot using the X button. 

Transform Method: Selects parameters for the PSD and TF plots. See Section 6. 


Active Plots: 
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Figure 9. Plot Information 
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5. DISPLAYS 


5.1 Strip Chart 

A strip chart plots signals versus time. The plot scrolls when the max time is reached. There can be up to 
4 channels on each strip chart. To plot more signals use multiple strip charts. The signal name appears on 
the left axis when there is one signal, or in a legend on top of the channel where there are multiple signals. 
To create a strip chart: 

Click the 6-Plot toolbar icon to pop up the Add New Plot Dialog Box (see Figure 8). Check the 
Strip Chart Option and then click Okay. 

Click on the title branch in the Active Plot Tree to pop up the Plot Information Dialog Box (see 
Figure 9). Change the title and/or number of channels. 

Click the first sub-branch to pop up the Time Dialog Box. Select the time signal and axis limits 
(see Figure 11) 

Click the remaining sub-branches to pop up the Channel Dialog Box (see Figure 12). Select the 
signed and axis limits. 

Click the Jet toolbar icon to activate the plot. An example strip chart is shown in Figure 10. 



Figure 10. Strip Chart 
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5.1.1 Strip Chart Time 

Click on the first sub-branch of the strip chart to pop up the time axis dialog box, as seen in Figure 11. 
The following controls are available: 

Select signal: Select the time signal. Only one signal can be selected. Usually this is the first 
signal, but this is not assumed and you must make the choice. 

Minimum Value, Maximum Value, Divisions: Set the max-min range of time displayed on the 
strip chart. 

Percent Scroll: Percentage the time across scrolls when the max time is reached. 
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5.1.2 Strip Chart Channel 

The strip chart defaults to 4 channels. To change click on the title branch in active plot tree and change 
the number of channels in the plot information dialog box. 

Click on the second and subsequent branches to select signals and vertical axis limits using the dialog box 
shown in Figure 12. The following controls are available: 

Select Signals: Click on the signal in the list box to make a selection. Make multiple selections to 
compare signals on the same axes. Shift-click and/or Ctrl-click to make multiple selections. 

AutoScale: Check for auto scaling. The vertical scale is increased as needed to fit the data, but 
does not automatically decrease. 

Minimum Value, Maximum Value, Divisions: Defaults when signals are selected to fit the data. 
Advanced Plot Editor: More options, not all implemented, so best not to use. 

Thresholds: Sets thresholds on the plot. 



Figure 12. Strip Chart Channel 
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5.i.3 Thresholds 

All of the plots can have thresholds, not just strip charts. The thresholds are plotted as solid red lines or 
line segments that mark important values on the subplots. Create the thresholds as shown in Figure 13: 
click on the channel, click on the “Define” button, and then enter the thresholds in the threshold dialog 
box. The thresholds are not displayed unless the “Display” checkbox is checked in the channel dialog 
box. An example of thresholds is shown in the figure marking acceleration limits. The following controls 
are on the threshold dialog box: 

Threshold Index: There can be up to 5 thresholds on a subplot. 

Horizontal Line: Enter a single value for thresholds that are horizontal lines. The lines will 
extend across the entire subplot. 

Line Segments: Enter x,y points that define line segment thresholds. 
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5.2 XYPlot 

Any signal can be plotted versus any other signal. There can be up to 4 channels, with the same horizontal 
axis signal, but usually there is just 1 channel. XY Plots do not scroll. To create an XY Plot: 

Click the 6-Plot toolbar icon to pop up the Add New Plot Dialog Box (see Figure 8). Check the 
XY Plot Option and then click Okay. 

Click on the title branch in the Active Plot Tree to pop up the Plot Information Dialog Box (see 
Figure 9). Change the title and/or number of channels. 

Click the sub-branches to pop up the Channel Dialog Box (see Figure 12). Select the signal and 
axis limits. 

Click the Jet toolbar icon to activate the plot. An example XY-Plot is shown in Figure 14. 

The plotting package (T-Chart) used in LOCATS has a “bug” and does not correctly plot lines that go 
right to left, so until an update to the plotting package is available the XY-Plot is not of much use. Try the 
Scatter Plot instead. 
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Figure 14. XY-Plot 
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5.3 Scatter Plot 

Any signal can be plotted versus any other signal. There can be up to 4 channels, with the same horizontal 
axis signal, but usually there is just 1 channel. Scatter plots plot every 100 th point as a dot. Scatter Plots do 
not scroll. To create a scatter plot: 

Click the 6-Plot toolbar icon to pop up the Add New Plot Dialog Box (see Figure 8). Check the 
Scatter Plot Option and then click Okay. 

Click on the title branch in the Active Plot Tree to pop up the Plot Information Dialog Box (see 
Figure 9). Change the title and/or number of channels. 

Click the sub-branches to pop up the Channel Dialog Box (see Figure 12). Select the signal and 
axis limits. 

Click the Jet toolbar icon to activate the plot. An example Scatter Plot is shown in Figure 15. 



Figure 15. Scatter Plot 
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5.4 PSD Plot 

The Power Spectral Density (PSD) plot is estimated from time series data using either Fourier or Wavelet 
transform methods. There can be up to 4 subplots, each containing one or more PSDs. Plotting more than 
one PSD on the same axis is a good way to compare magnitudes. The frequency axis is common to all of 
the subplots. To create a PSD plot: 

Click the 6-Plot toolbar icon to pop up the Add New Plot Dialog Box (see Figure 8). Check the 
“Estimated PSD” Option and then click Okay. 

Click on the title branch in the Active Plot Tree to pop up the Plot Information Dialog Box (see 
Figure 9). Change the title and/or number of channels. 

Starting from the Plot Information Dialog box select the transform method and parameters (see 
Section 6). 

Click the first sub-branch and select the frequency axis limits (see Figure 17) 

Click the remaining sub-branches to pop up the Magnitude Dialog Box (see Figure 18). Select the 
signal and axis limits. 

Click the Jet toolbar icon to activate the plot. An example PSD Plot is shown in Figure 16, shown 
next to the time series from which the PSDs were estimated. 



Figure 16. PSD Plot 
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5.4.1 PSD Frequency 

Click on the first sub-branch of the PSD plot in the Active Plot Tree to pop up the Frequency Dialog Box 
as shown in Figure 17. The same frequency axis is used for each of the subplots. The controls on the 
dialog box are: 

Autoscale: Doesn’t work well for log axes and is disabled. 

Minimum Value, Maximum Value, Divisions: Frequencies. 

Nice Values: for min, max, and divisions. 

Options: Frequencies are rad/sec or Hz, linear or loglO. The min and max values are rad/sec or 
Hz depending on the selected option. 


Active Plots: 
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Figure 17. PSD Frequency 
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5.4.2 PSD Magnitude 

Click on the second and higher sub-branches of the PSD plot to pop up the Magnitude Dialog Box as 
shown in Figure 18. The controls on the dialog box are: 

Select Signals: Click on the signal in the list box to make a selection. Make multiple selections to 
compare PSDs on the same axes. Shift-click and/or Ctrl-click to make multiple selections. 

AutoScale: Check for auto scaling. The vertical scale is increased as needed to fit the data, but 
does not automatically decrease. 

Minimum Value, Maximum Value, Divisions: Magnitude, scaled according to the selected 
option. 

Nice Values: for min, max, and divisions. 

Options: Magnitude can be in dB, power dB, or absolute. 

Thresholds: See Figure 13. 


Active Plots: 



j“h Strip Chart 1 

Time 
_ DLOfl 

U the. ' 

PSD of DLOII and Theta (using Wavelets) 
Frequency (rad/sec) 

11 


DLOII, THE 


. ■■ 


X mi 00,3 

ii 

-400,100,5 

■' ;#5»* 

-400,400,4 


♦200,t0Q,3 


•120,0,8 


•120,40,4 


-120,180,6 


•80.80,4 

: 


: 


j power dB(IQIoglQ) 


absolute (Snearl 

J 


Figure 18. PSD Magnitude 
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5.5 TF Plot 

The Transfer Function (TF) Plot is estimated from input and output time series data using either Fourier 
or Wavelet transform methods. There can be up to 4 subplots, each containing a different part of the 
transfer function or a parameter estimated from the frequency response. A transfer function can be linked 
to the previous TF Plot, so that more than 4 subplots can be created without duplicating the computations 
needed to estimate the transfer function. To create a TF plot: 

Click the 6-Plot toolbar icon to pop up the Add New Plot Dialog Box (see Figure 8). Check the 
“Estimated TF’ Option and then click Okay. 

Click on the title branch in the Active Plot Tree to pop up the Plot Information Dialog Box (see 
Figure 9). Change the title and/or number of channels. 

In the Plot Information Dialog and Transform Method Dialog Boxes select the transform method 
and parameters (see Section 6). 

Click the first sub-branch and select the input and output signals and the frequency axis limits 
(see Figure 20) 

Click the remaining sub-branches to pop up the Plot Type Dialog Box (see Figure 21 and Figure 
22). Select the Plot Type (e.g., Magnitude, Phase, and so on) and then enter the vertical axis 
limits. 

Click the Jet toolbar icon to activate the plot. An example TF Plot is shown in Figure 16, shown 
next to the time series used to estimate the transfer function. 



Figure 19. TF Hot 
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5.5.1 TF Signals and Frequency Axis 

Click on the first sub-branch of the TF Plot in the Active Plot Tree and the TF Signals and Frequency 
Axis Dialog Box pops up as shown in Figure 20. The controls are: 

Input Channel and Output Channel: Select one signal in each list box to define the transfer 
function. 

AutoScale: Disabled. 

Minimum Value, Maximum Value, Divisions: Frequencies. 

Nice Values: for min, max, and divisions. 

Options: Frequencies are rad/sec or Hz, linear or loglO. The min and max values are rad/sec or 
Hz depending on the selected option. 

Link to Previous TF: Enabled if the previous plot on the Active Plot Tree is a TF Plot, in which 
case up to four more subplots can use the same TF estimate. 
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Figure 20. TF Signals and Frequency Axis 
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5.5.2 if Magnitude, Ftiase, and Coherence 

Click on the sub-branches below the frequency to pop up the Plot Type Dialog Box shown in Figure 21. 
The first five plot types are spectral and cross-spectra quantities: 

Mag: \G(jo))\ = S yx (joi)/ S^ijco) , where S yx (j( 0 ) = smoothed cross spectra 

Phase: Phase [G(jty)] = Phase[5 ) , ;c (;<y)] 

Coherence: p 2 (j(o) =| S yx (jo >)\ 2 l[S xx {jco)S yy (jGj)\ 

Input Power: S^ijcS) = smoothed input spectra 

Output Power: Syy ( jco ) = smoothed output spectra 


The example TF Plot in Figure 19 has subplots of magnitude, phase, and coherence. The remaining 
controls in the Plot Type Dialog Box are similar to those for the PSD Magnitude, except the Nice Values 
and Options change appropriately. Note that the phase can either be pinned to a selected 360 degree range 
or can be unwrapped. The plots can be either lines or dots, where dots are sometimes better when plotting 
transfer function metrics. 
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Figure 21. TF Magnitude, Phase, and Coherence 
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5.5.3 Transfer Function Metrics 

The remaining Plot Types are parameters estimated from the frequency response. A value is obtained 
each time the transforms are computed, and then the metrics are plotted versus time. An example is 
shown in Figure 22 (Run 69 from Locats BAE Sim Data, the labels were inserted using Microsoft Paint). 



Figure 22. TF Metric Plots 

The metrics that can be selected from the Plot Type Dialog Box are listed below: 

Wc vs Time: Unit magnitude crossover frequency of |G(y<y)| . Mainly for loop transfer functions 
(LTFs), in which case (O c is the bandwidth and the frequency at which the phase margin is 
computed. 

PM vs Time: The Phase Margin (PM) is 180 plus the phase of G(jai) at co-Q) c . Mainly for 
LTFs, in which case the phase margin is the extra phase at 0) = 0) c that will destabilize the 
system. 

W180 vs Time: The frequency where the phase of G(jcu) crosses -180 degrees. 

GM vs Time: The Gain Margin (GM) is minus the gain in dB of G(jco) at a> = a\ go . Mainly for 
LTFs, in which case the gain margin is the gain increase that will destabilize the system. 

Airplane BW vs Time: The airplane bandwidth is the mini mum of the phase and gain 
bandwidths. 

Wc and W180 vs Time: A combined plot of 0) c and . 
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Gain and Phase BWt The gain bandwidth is the lowest frequency where crosses 6 dB 

plus the magnitude at cq = o\%q . The phase bandwidth is the frequency where G(jai) crosses 
-135 degrees. The gain and phase bandwidths are mainly of interest for manual control 
analysis when G(jco) is an attitude controlled element. If the human operator acts like a 
constant gain, then the gain bandwidth is the (O = o \% q frequency that results from a gain 
selection with a gain margin of 6 dB. The phase bandwidth is the 0 )=co c frequency that 
results from a gain selection with a phase margin of 45 degrees. 

TauP vs Time: Taup is a measure of the effective delay of the controlled element. It is defined as 
one half the phase slope of G{joj) between and 2t% 0 . Systems with large TauP 
(larger than about 150 msecs) require a higher workload on the human operator. 

TauP vs BW: A cross plot of TauP and airplane bandwidth. 


To set the parameters click on the appropriate branch in the Active Plot Tree. Select a metric Plot Type 
and then the dialog box changes as shown in Figure 23. The time signal must be selected, and the axis 
limits are needed for both axes. The “Nice Values” and “Options” change depending on the other 
selections. 







6. TRANSFORM METHODS 


6.1 Transform Method Dialog Box 

Fourier and wavelet transforms of time series are used to create Power Spectral Density (PSD) and 
Transfer Function (TF) plots. LOCATS was developed to demonstrate the use of wavelet transforms for 
this purpose, and so selecting transform methods and their parameters is at the heart of this program. Use 
the following dialog boxes and controls to do so, as shown in Figure 24. 

Click on the plot title in the Active Plot Tree to pop up the Plot Information Dialog Box. 

Use the transform method list box to select the transform method. 

Click on “Timing” push button to pop up the Transform Method Tabbed Dialog Box with the 
“Timing” tab selected. 

Click on the “Setup” push button to pop up the same Tabbed Dialog Box with either the “FFT” or 
“CWT” tab selected. 

Transform Method Tabbed Dialog Box has the following tabs: 

Timing: Set parameters for the sliding window, persistence, and time domain smoothing. 

Fmax: Set the max frequency at which the transform is computed. 

FFT: Set parameters for Fourier transform methods. 

CWT: Set parameters for Continuous Wavelet Transforms. 

LLS: Set parameters for LLS parameter estimation. 
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6.2 Timing Tab 

The Timing Tab on the Transform Method Dialog Box is shown in Figure 24. 

Information: 

The sample period is determined by subtracting the first two times in a data file and then stored in the 
configuration file. If known, the following information is displayed: 

dt [sec] = sample period 
l/(2*dt) [Hz] = foldover frequency 
1/T [Hz] = bin size 

Length of Transform: 

Use the edit boxes to enter: 

T [sec] = length of transform 

N [points] = number of points in transform, where T = N*dt 

Enter one of these and the other is automatically updated. Use the up and down arrows to change N by 
powers of 2. The parameters T and N can also be changed in the FFT and CWT tabs, in which case T and 
N are changed in the other tabs to be consistent. 

The number of points does not have to be a power of 2, the FFT algorithm breaks N down into prime 
factors to speed up the calculation, and the CWT computation time scales with N. 

Interval Between Transforms: 

Use the edit boxes to enter: 

Tincr [sec] = time between transform calculations 

Nincr [points] = incremental number of points in transform, where Tincr = Nincr*dt 

Enter one of these and the other is automatically updated. Use the up and down arrows to change Nincr by 
powers of two. The incremental number of points does not have to be a power of 2. If many transforms 
are being computed, try setting Nincr to values like 5 and 7 so that the calculations rarely occur during the 
same time step. 

At the start of the run there are less than full amount of N points available. The transforms are 
nevertheless computed every Nincr points, with zero fill until the full number of points is available. This 
is why the spectra appear to grow out of the bottom of the plot at the start of the run. The same does not 
happen for transfer functions because the input and output spectra are reduced by the same amount, 
though the variance of the estimate starts large and then reduces. 

Sliding Window: 

The length and increment define the sliding window shown in Figure 25. If Tincr = 0.1 [sec], for 
example, then the transform is computed and plotted 1/Tincr = 10 times a second. 


] 


] 


Increment time: Length of transform: 

Tincr = Nincr * dt T=N*dt 


Figure 25. Sliding Window 
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Time Domain Averaging: 

Sets the number of adjacent-in-time spectra that are averaged. The time domain averaging set here is used 
for both FFT and wavelet transforms. The number of adjacent-in-frequency spectra is determined from 
controls in the FFT and CWT tabs. See Section 6.5 for examples and further information about averaging. 

Persistence: 

P = persistence is the number of lines plotted for the PSD and TF plots. The line for the current time is 
always plotted, together with P -1 previous lines that fade with receding time. Persistence makes it 
visually more apparent when changes occur, and makes the variance of the estimate more apparent. An 
example with and without persistence is shown in Figure 26. The variance of the estimate is significantly 
larger above 2 rad/sec. 



Figure 26. Persistence 


TR 1341-3 


26 


6.3 Fmax Tab 

The maximum frequency at which the spectra is estimated is set using the fmax tab shown in Figure 27. 
The foldover frequency is shown in Hz and rad/sec. 

The checkbox selects the foldover frequency as the maximum frequency. 

Or, the max frequency can be entered either in Hz or rad/sec, with the other being automatically updated. 


TFofTHE/DtON §§ 



6.4 FFT Tab 

Parameters that define the Fast Fourier Transfer (FFT) are set using the FFT tab shown in Figure 28. 

Binning (Frequency Averaging): 

Adjacent frequency bins are averaged if the “Use log binning” box is checked. All of the FFT bins from 
1/T to fmax are otherwise used. The number of adjacent bins averaged increases with frequency (if Fratio 
is greater than one) so that the average frequencies are approximately equally spaced on a log scale. The 
frequency of the averaged set of bins is the average frequency. The log binning parameters are: 

Nmin: The minimum number of bins averaged, primarily sets the number of low frequency bins 
that are averaged. 

Fratio: The approximate ratio of adjacent averaged frequencies, so that the averaged frequencies 
are approximately log-spaced. The same number of bins is averaged across the frequency 
range if Fratio = 1.00. A Fratio larger than one is approximately one plus the damping ratio, 
so systems known to have lightly damped modes should use Fratio equal to 1.01 to 1.05. 
Systems known to be well damped should use Fratio equal to 1.10 or 1.20. 

See Section 6.5 for an example of log binning and for further information about smoothing. 
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Figure 28. FFT Tab 


Length of Transform: 

The number of points, length in seconds, minimum frequency in Hz and rad/sec all depend on each other. 
Set one, whichever is the most relevant for you, and the others are automatically updated. The lengths in 
the “Timing” and “CWT” tabs are also changed. Use the arrows to change the number of points by 
powers of 2, though it is not necessary that N actually be a power of 2. 

Cosine Taper Fraction: 

The time series is tapered at each end by a half cycle of a cosine with the selection fraction. The 
maximum fraction of 0.50 is equivalent to the cosine window. The taper helps to reduce the end effects 
caused by discontinuities at the beginning and end of the time series. A value of 0.05 or 0.10 is 
recommended. 
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6.5 (J YVT l ab 

Parameters that define the Continuous Wavelet Transform (CWT) are set using the CWT tab shown in 
Figure 29. 

Continuous Wavelet Transform: 

Select the type of transform, the length in cycles, and the cosine taper fraction. The wavelet transform 
expands or contracts in time so that the length in cycles remains the same. Click the “Show” button to see 
a plot of the mother wavelet and its Fourier transform. The different types of transforms are defined and 
compared in Section 6.6. 

Length of transform (at fmin): 

The length of the transform in seconds depends on the frequency. The maximum length in seconds or 
points is set, and then the minimum frequency in Hz or rad/sec depends of this length and the number of 
cycles. (For the FFT the minimum frequency is 1/T Hz, here it is Nc/T Hz). Set any one of the four 
parameters and the others are automatically updated. The max length in the “T imin g” and “FFT” tabs is 
also updated. 

Number of frequencies: 

The wavelet transform is computed at Nw frequencies log-spaced from fmin to fmax. Set either Nw or 
Fratio and the other quantity is automatically updated. 

“Frequency Domain Averaging”, sets the number of spectra bins averaged across frequency. See Section 
6.7 for examples and further information on smoothing. 
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Figure 29. CTW Tab 
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6.6 Mother Wavelets 
Mother Wavelet Dialog Box 

The “Show” push button on the “CWT” tab pops up the “Continuous Wavelet Transform” (a.k.a. “Mother 
Wavelet”) Dialog Box shown in Figure 30. The mother wavelet and its Fourier transform are displayed. 

The parameters that define the wavelet are the same as in the “CWT” tab. Each time a change is made the 
new wavelet is displayed. 

Check the “Show previous magnitudes” box to compare envelopes in time and frequency. To reset the 
comparison cancel back to the tabbed dialog box and re-press the “Show” button. 

Check the “Show imaginary part” box the show both the real and imaginary parts of the wavelet. 



Figure 30. Mother Wavelet Dialog Box 


Mother Wavelets: 

All of the wavelets are a complex exponential with an envelope: 

where /Hz is the frequency of the wavelet, u is the shift in time, and g(t) is the envelope. The mother 
wavelet has a frequency of / = 1 Hz and a shift of u = 0 seconds. 

Morlet: The envelope for the Morlet wavelet is: 

Morlet: g{t)=-^e^ t ~ hhift ^ ' P 

ylrf 
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This is also called a “shifted Moriet" wavelet, because it is shifted to the right to make it causal. 
(Wavelets are causal if they are non-zero only for positive time). The envelope is a Gausian bell-shaped 

curve with a standard deviation of c — -Jfi/2 . The shift is t shi j t = 3<j and the enveloped is truncated at 

t fop ± 3<r . This range is set equal to the length of N c cycles, so that 6<x =N C I f . The Moriet wavelets 

with 5 and 10 cycles are compared in Figure 31a. The wavelet with 10 cycles is half the amplitude in both 
time and frequency. 

Rayleigh: The envelope for the Rayleigh wavelet is: 

Rayleigh: g(t) = ^te~ {2 ' & 

The name comes from the Rayleigh probability density. The Rayleigh and Moriet wavelets are compared 
in Figure 31b. The frequency response of the Rayleigh has a slightly narrower bandwidth, but this 
difference is not significant. It is the faster rise of the Rayleigh in the time domain that makes this wavelet 
significantly different from the Moriet. The faster rise results in faster tracking of changes in the spectra 
estimated using this wavelet. The maximum value in the Rayleigh envelope occurs at time 

* peak ~ Jpii x(l//) . The envelope is truncated at time zero and four times the peak, and this range is 

set equal to the length of N c cycles, so that 4t peak =N C / f . 

Erlang: The envelope for the Erlang wavelet is: 

n.n-1 

Erlang: g(t)~ e~ at 

The name comes from the Erlang probability density. The Erlang and Moriet wavelets with 5 cycles are 
compared in Figure 31c. The order parameter n = 3 is fixed and not made available to the user for 
change. With this order the Erlang and Rayleigh are almost the same. The Erlang has a slightly smaller 
bandwidth than the Rayleigh in the frequency range, and hence is slightly broader in the time domain. 
Our experience with the Erlang wavelet has yielded slightly better results at estimating parameters and 
that is why we have been using the Erlang wavelet and not the Rayleigh for most of the examples in this 
user’s guide. The maximum value of the Erlang envelope occurs at time t peak =(n-l)l a . The envelope 

is truncated at time zero and four times the peak, and this range is set equal to length of N c cycles, so that 
^ peak ~ N c I f • 

Weibull: The envelope for the Weibull wavelet is: 

Weibull: g(t) = abt b ~ l e~ a ‘ h 

The name comes from the Weibull probability density. The Weibull and Moriet wavelet with 5 cycles are 
compared in Figure 3 Id. The order parameter b = 3 is fixed and not made available to the user for 
change. With this order it turns out that the Weibull with 2N C cycles is a close match to the Moriet with 

N c cycles. The maximum value of the Weibull occurs at t peak = [(b-l)/(ab)] Ub . The envelope is 
truncated at time zero and four times the peak, and this range is set equal to length of N c cycles, so that 
^tpeck = N c ff. (In retrospect truncating the envelope at two times the peak would be better, but the 
choice was made to use four times to be consistent with the other skewed envelopes). 
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Cosine Taper: The envelope for the cosine taper wavelet is: 


Cosine taper: g(t) = <{ 


a 

2 


l+cos 


nt \ 


* taper J 


a 


a 

"2 


f 

l + cos 
V 


t taper j 


0<t<t, 


taper 


haper —t<T t taper 


T-t taper <t<T 


where the taper time is a given fraction of the total time T, and a = 1/[(1 - t taper )T] so that the area under 

the envelope is unity. The cosine taper and Morlet wavelets with 5 cycles are compared in Figure 31e. All 
of the other Fourier transforms had smooth tails, but here the Fourier transform has scallops, reminiscent 
of FFT windows, which is actually what the cosine tapered wavelet is designed to be. The difference, 
however, as with all wavelets is that the wavelet scales with frequency. For a given frequency the cosine 
taper has better frequency resolution than the Morlet wavelet at the expense of more leakage in the side 
lobes. The cosine taper wavelet is an interesting idea, but we have not found in our analysis to date better 
estimation results. There may be cases we haven’t yet discovered where this wavelet is the one to use, so 
it remains in the stockpile. 



a) Morlet Wavelet with 10 cycles compared with 5 cycles 



b) Rayleigh Wavelet with 5 cycles compared with Morlet 5 cycle 
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e) Cosine Taper Wavelet with 5 cycles and 10% taper compared with Morlet 5 cycle 


Figure 31. Mother Wavelet Comparison 
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6.7 LLS Tab 

Parameters for the Linear Least Square (LLS) estimation problem are set using the LLS tab shown in 
Figure 32. Coefficients of a z-transform are estimated and then used to compute the frequency response. 

Numerator and Denominator Order: 

Enter the numerator and denominator orders, respectively m and n of the estimated z-transform. The 
implementation is general and high orders can be entered, but generally n should be in the range 2 to 6 
and the relative order n — m should be zero or one. 

Length of Sliding Window: 

Set the length T = Ny.dt [sec] of the sliding window. Enter either the length in seconds or points, and the 
other parameter is automatically updated. The length in the ‘Timing” tab is also changed. The number of 
points can be changed by the arrows to be powers of 2, though there is nothing special here about these 
powers. 

Frequencies: 

The z-transform is estimated and then the frequency response computed and returned for plotting. The z- 
transform coefficients are not returned or displayed The frequency response is computed using Nw log- 
spaced points from fmin to fmax Hz. Enter Nw points and fmin Hz or wmin rad/sec in the “LLS” tab. 
Enter fmax Hz or wmax rad/sec in the “fmax” tab. 
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Figure 32. LLS Tab 
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6.8 LLS Estimation Method 

The transfer function parameter estimation method implemented here is the one-step prediction method 
based on the input and output time series. This is a “bare-bones” parameter estimation method that is used 
for comparison with the transform methods 


The LLS parameter estimation method is briefly described. The starting point is the input and output 
times series x ( and y,- defined for points in the sliding window. The objective is to estimate the 
parameters of the z-transform: 


G(z) = 


c m z"'+- + c Q 

Z n +d n _iZ n *4 bd Q 


The one-step prediction of the output is based on the previous inputs and outputs: 
h =~{ d n-iyk-l + • • • + 4) yfc-n ) + {c m u k+m-n + * ‘ ' + ) 


The LLS estimation problem finds the parameters that minimize the least square of the error = y i - y,- 

for points in the sliding window. The error is linear in the z-transform coefficients, and hence the name 
“Linear Least Squares.” 

The example in Figure 33 compares the transfer function magnitude computed using the Erlang wavelet 
transform and using the LLS estimation problem (Run 69 from the LOCATS data). The LLS parameters 
are those shown in Figure 32. Here the comparison looks good. The LLS estimate is smoother because the 
selected order of three is not large enough to represent jagged peaks and valleys. Generally, however, the 
LLS estimate does not do as well, having a larger variance and too often giving nonsense. 

There are many variations of the LLS estimation problem that will improve the transfer function estimate, 
but only the “bare-bones” version is implemented in LOCATS. Several LLS variations were explored and 
implemented in Matlab, the point being that the simple version in LOCATS is not good enough, and in 
fact the LLS variations that do the best job of estimating the transfer function use transforms of the time 
series as an initial step in the z-transform coefficient estimation. 



Figure 33. LLS Example 
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6.9 Smoothing 
Smoothing Parameters: 

The spectra are averaged in time and frequency as defined by the parameters: 

‘Time Domain Averaging” in the “Timing” tab is the number of spectra averaged in time. 


“Nmin” and “Fratio” in the “FFT” tab defines frequency averaging for FFTs. 


“Frequency Domain Averaging” in the “CWT” tab is the number of spectra averaged in 
frequency for wavelet transforms. 


The average is of the auto-spectra and the cross-spectra. The transfer function is the ratio of the averaged 
cross-spectra and the input auto-spectra. The coherence also uses the averaged quantities, and if no 
averaging in time or frequency the coherence is unity. 

The Smoothing Window: 

The cross-spectrum is averaged in time and frequency: 


$xy * tj ) 
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i+(N t - 1)/2 
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k=i-(Ni- 1)/2 
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t=M -Nj 


$xy (^t » ) 


A A 

The same averaging is also done for the auto-spectra and Syy .The A r ,- frequencies, where A,- is odd, 
are centered about the frequency o \ , and the N j times are at the current time tj and previous times (and 
hence is average is causal). The window used for the average is shown in Figure 34. 

The total time and frequency range define a rectangle, and at the edges of this rectangle the averaged 
spectra have less than the maximum number of times and frequencies available. The numbers N t and N j 

are reduced to the number actually used in the average. Hence, the expected values of averaged and un- 
averaged spectra are the same. 
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An example of time and frequency domain smoothing for a Erlang 5-cycle wavelet transform is shown in 
Figure 35. The smoothed PSD is of pitch (Run 69 from the LOCATS database, averages 41 adjacent 
times 0.16 seconds apart, and 5 adjacent frequencies for 120 frequencies from 0.19 to 20 rad/sec). 



Figure 35. Wavelet Smoothing 

FFT Log Binning: 

Adjacent FFT frequency bins are averaged by checking the “Use log binning” box in the FFT tab. The dc 
component is not used in the average, the low frequency bin is at 1/T Hz, and the maximum frequency is 
fmax Hz as set in the fmax tab. The number of frequency bins used for the average (usually) increases 
with frequency so that the adjacent averaged frequencies have approximately equal ratio. See Section 6.4 
for the log binning parameters. An example of log binning is shown in Figure 36, the PSD of pitch, using 
the same time series as in Figure 35. There is no smoothing in time. 



Figure 36. FFT Log Binning 
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6.10 LOCATS Timing 

6. 10. 1 Timing Loop 

The real time signals used by LOCATS are obtained from the Mil 1553 bus via software data requests. 
These requests are inside a timing loop as follows: 

Top of timing loop 

Start 20 msec timer and record current time 
Request signals 
Store signals 

Transform calculations (if any) 

Plotting (if any) 

Loop to use up remaining part of 20 msec (if any) 

End of timing loop 

The calculations depend on the choice of plots. Strip charts are updated each cycle. The time series for 
PSD and TF plots are stored every cycle, but the transform calculations and plotting are updated every 
Nincr samples, where Nincr is a specified number of increments. For example, if one transform has Nincr 
= 5 and a second has Nincr = 7, then they are computed and plotted respectively every 5 and 7 samples, 
overlapping every 35 samples. 

Another factor in the timing is the number of lines drawn on each plot. The PSD and TF plots can have 
multiple lines, as determined by the “persistence” parameters. Drawing multiple lines turned out to have a 
larger timing penalty then computing transforms. 

If the calculations and plotting take longer than 20 msecs then the final part of the timing loop is 
bypassed, and then next cycle starts by resetting the timer to zero and requesting the next batch of signals. 
The time at the start of each cycle is stored and the delta time indicates whether or not a slip occurs. There 
is not a master clock with 20 msec increments. The 20 msec timer starts when the previous cycle is 
completed. 

6. 10.2 Timing and Quantization of Buffered Signals 

The signals on the Mil 1553 bus tire updated according to the simulator software. The signals are not 
under the control of LOCATS and their updates are not synchronized with LOCATS. The Mil 1553 bus 
holds the previous value of each signal until it is updated. 

A detail of signals from LOCATS Run 41 is shown in Figure 37. (There figures use post-processed data 
collected by LOCATS, but the plots are from Matlab and are not part of LOCATS). Each dot is a 
recorded value for that signal. The signal timing and quantization can be determined from these plots. 
Comments: 

• The first line is the delta time between successive signals, and in this 2.5 second 
segment of data the delta time holds steady at 20 msec indicating there is no slippage. 

• Each sample of the Q signal is held for 2 cycles, indicating the update rate is about 
half of the 50 Hz rate set for LOCATS. 

• Each sample of the VCAS signal is held for at least 4 cycles, indicating an update 
rate about one-forth of 50 Hz. Sometime the signal is held for more than 4 cycles, 
due to quantization. 

• Most samples of the THE signal are held for 1 cycle, and occasionally 2 cycles, 
indicating an update rate of about 50 Hz but not quite synchronized with the 
LOCATS update. 
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• The DLON samples are all held for one cycle, perfect synchronization over this 
segment of data. 

• The lateral axis signals (PHI, P, and DLAT) are all held for many cycles, due mainly 
to quantization. The pilot input is primarily pitch for this run. 

6.10.3 Timing Tests 

LOCATS requests data from the Mil 1553 bus every 20 msec, but slips when the calculations and/or 
plotting takes more than this amount. The time of each sample is recorded from a precision timer built 
into the PC, and the delta time can therefore be used to test the computation time. 

Several LOCATS runs were used primarily to record calculation times. The type of input is not relevant 
to the timing, but for the record each of these timing test runs was a single pitch doublet with data 
collected for 20 to 30 seconds. The number of plots and the length of the transform calculations were 
varied for each ran. The transform calculations were either FFTs or wavelets, computed every Nincr 
samples, one time for each plot. The “persistence” is the number of lines drawn for each PSD plot, a 
persistence of 10, for example, plots the current PSD line and the 9 previously calculated PSD lines. 

The results of the timing tests are summarized in Table 1. The delta time plots for most of the runs are 
included in Figure 38 (the runs not included have flat, 20 msec delta time plots). 

Conclusions: 

• No slippage with just strip charts. 

• No slippage for a single PSD plot using either FFTs or wavelets up to length 4096. 

The number 4096 can be increased some, but the tests are not sufficient to determine 
an exact bound. 

• Plotting with persistence results in severe timing slippage, taking as much as 10 times 
longer than then the transform calculations. 

Recommendations: 

• Use the current version of LOCATS data with just strip charts. This is the safest way 
to obtain data with no slippage (this was done for the LOCATS runs above R8). 

• Change the LOCATS software to separate the data collection from the calculations 
and plotting. Do this either with a single computer using interrupt driven multiple 
threads, or with separate computers. Writing this type of software was beyond the 
scope of the current project. 
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Table 1. LOCATS Timing Tests 


LOCATS 

Run# 

Description 
Of Run 

Real Time Plots 

# Samples out of first 
1000 that slip more than 
0.1 msec (nominal value is 
20 msec) 

39 

Pitch doublet 

Strip chart only 

0 

41 

Pitch doublet 

Strip chart 

4096 point FFT (Persistence =1) 

0 

42 

Pitch doublet 

Strip chart 

4096 point FFT (Nincr = 6, Persistence =1) 
4096 point Wavelet (Nincr = 8, Persistence^)) 

158 

(slips to about 30 msec 
every 24 samples when 
transforms line up) 

43 

Pitch doublet 

Strip chart 

4096 point FFT (Nincr = 6, Persistence =10) 
4096 point wavelet (Nincr = 8, Persistence = 10) 

196 

(slips to 40 to 60 msec for 
each transform plot, slips to 
140 to 160 msec every 24 
samples when transform 
plots line up) 

60 

Pitch doublet 

Strip chart 

8192 point wavelet (Nincr = 6, Persistence = 1) 

136 

(slips 0 to 4 msec for each 
transform) 

61 

Pitch doublet 

Strip chart 

4096 point wavelet (Nincr = 6, Persistence =1) 

0 

62 

Pitch doublet 

Strip chart 

6144 point wavelet (Nincr = 6, Persistence = 1) 

3 

(slips more than 0.1 msec 3 
times, with a max slip of 
0.6 msec) 

63 

Pitch doublet 

Strip chart 

8196 point FFT (Nincr = 6, Persistence = 1) 
6144 point wavelet (Nincr = 7, Persistence = 1) 

35 

(slips 6 to 10 msec every 
42 samples when transform 
line up) 
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Locate: Run#43 (PD st+ FFT +wave+pers): 
dettatimc (msec) 



Figure 38. (Part 1 of 2) LOCATS Timing Tests 


TR 1341-3 


43 






msec ' .• msac 


Locals: Run#43 (PD st+FFT+wave+pers): 
delta time (msec) 



Locals: Run#6Q (PD stnp+wave/8192): 
dels time (msec) 



Locals: Run#62 (PD slrip+wave/61 44): 
della time (msec) 



Figure 38. (Part 2 of 2) LOCATS Timing Tests 
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